2024-09-10T11:33:09.376 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T11:33:09.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:33:09.490 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102 branch: wip-athakkar-testing-2024-09-04-1837 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/snapshot}} email: null first_in_suite: false job_id: '7899102' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-athakkar-testing-2024-09-04-1837 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-04-1837 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 owner: scheduled_khiremat@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9123 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 sleep_before_teardown: 0 subset: 3/4 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-04-1837 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMtYj9+ELleOaZhZ8o3eJqkbUG+rYWQuqiE5jQlwIzBc20mW+BwzPtrUfIPrOZO6Hqo5PnbZzpgc+TAFr/zS+m4= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuhE1wMnCMxFARkBr6Iu/gWdNMtVaMKRel2c3vNNwI4ItN57eUDBWNhkCicMNJzmIgamd6q6FYYmAWIQPQMzIg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_07:26:29 tube: smithi user: khiremat verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T11:33:09.491 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa; will attempt to use it 2024-09-10T11:33:09.492 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks 2024-09-10T11:33:09.492 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T11:33:09.493 INFO:teuthology.task.internal:Checking packages... 2024-09-10T11:33:09.515 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73' 2024-09-10T11:33:09.516 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T11:33:09.516 INFO:teuthology.packaging:ref: None 2024-09-10T11:33:09.516 INFO:teuthology.packaging:tag: None 2024-09-10T11:33:09.516 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-04-1837 2024-09-10T11:33:09.516 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:33:09.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-athakkar-testing-2024-09-04-1837 2024-09-10T11:33:09.660 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:33:09.661 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T11:33:09.668 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T11:33:09.668 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T11:33:09.682 INFO:teuthology.task.internal:Saving configuration 2024-09-10T11:33:09.699 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T11:33:09.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T11:33:09.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:27:38.607024', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/mnnyapwbdpW2qYNcYFVEEcl5uEBTEwSbPlhy5eAhj'} 2024-09-10T11:33:09.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:27:38.605221', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIIhqBKYgzt9mHB6LshX/HVFquOpA5Ti6ghL3vZtvHje'} 2024-09-10T11:33:09.751 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T11:33:09.757 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T11:33:09.757 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T11:33:09.757 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T11:33:09.819 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe25d8f7ac0>, signals=[15]) 2024-09-10T11:33:09.819 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T11:33:09.824 INFO:teuthology.task.internal:Opening connections... 2024-09-10T11:33:09.825 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:33:09.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:33:09.914 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:33:09.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:33:09.996 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T11:33:10.004 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-10T11:33:10.009 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-10T11:33:10.009 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-10T11:33:10.056 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T11:33:10.056 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T11:33:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2024-09-10T11:33:10.058 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-10T11:33:10.081 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-10T11:33:10.086 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-10T11:33:10.086 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-10T11:33:10.134 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T11:33:10.134 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-09-10T11:33:10.134 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-09-10T11:33:10.134 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T11:33:10.134 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T11:33:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-09-10T11:33:10.135 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-10T11:33:10.153 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T11:33:10.162 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T11:33:10.168 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T11:33:10.168 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:33:10.170 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:33:10.182 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T11:33:10.188 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T11:33:10.189 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:33:10.222 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:33:10.247 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T11:33:10.304 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T11:33:10.320 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T11:33:10.320 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T11:33:10.321 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:33:10.321 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:33:10.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:33:10.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:33:10.327 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-10T11:33:10.327 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-10T11:33:10.373 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2024-09-10T11:33:10.373 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.15.0-56-generic 2024-09-10T11:33:10.374 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-09-10T11:33:10.375 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-09-10T11:33:10.375 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.15.0-56-generic 2024-09-10T11:33:10.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-10T11:33:10.495 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-10T11:33:10.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-10T11:33:10.644 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T11:33:10.646 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T11:33:10.665 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T11:33:10.665 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T11:33:10.727 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T11:33:10.735 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T11:33:10.758 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T11:33:10.761 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T11:33:10.866 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T11:33:10.871 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T11:33:10.959 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T11:33:10.964 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T11:33:10.967 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T11:33:10.967 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T11:33:10.970 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T11:33:10.975 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T11:33:10.977 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T11:33:10.978 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T11:33:10.984 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T11:33:10.984 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T11:33:10.987 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T11:33:10.987 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [730 kB] 2024-09-10T11:33:10.993 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T11:33:11.001 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T11:33:11.001 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T11:33:11.002 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T11:33:11.005 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T11:33:11.005 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T11:33:11.005 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T11:33:11.007 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T11:33:11.007 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [730 kB] 2024-09-10T11:33:11.014 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T11:33:11.023 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T11:33:11.026 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T11:33:11.026 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T11:33:11.026 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T11:33:11.033 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T11:33:11.034 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T11:33:11.034 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T11:33:11.035 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T11:33:11.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T11:33:11.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T11:33:11.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T11:33:11.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T11:33:11.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T11:33:11.037 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T11:33:11.051 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T11:33:11.051 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T11:33:11.051 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T11:33:11.052 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T11:33:11.053 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T11:33:11.053 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T11:33:11.053 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T11:33:11.054 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T11:33:11.054 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T11:33:11.054 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T11:33:11.203 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T11:33:11.204 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T11:33:11.622 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T11:33:11.622 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T11:33:11.638 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T11:33:11.638 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T11:33:11.647 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T11:33:11.647 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T11:33:11.647 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T11:33:11.648 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T11:33:11.648 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T11:33:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T11:33:11.744 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T11:33:11.745 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T11:33:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T11:33:11.756 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T11:33:11.756 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T11:33:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T11:33:11.779 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T11:33:11.780 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T11:33:11.801 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T11:33:11.801 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T11:33:11.804 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T11:33:11.805 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T11:33:11.806 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T11:33:11.806 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T11:33:11.806 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T11:33:11.806 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T11:33:11.808 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T11:33:11.884 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T11:33:11.886 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T11:33:11.887 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T11:33:17.179 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 15.8 MB in 2s (7,351 kB/s) 2024-09-10T11:33:17.226 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 15.8 MB in 2s (7,507 kB/s) 2024-09-10T11:33:18.605 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:33:18.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T11:33:18.675 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:33:18.711 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:33:18.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T11:33:18.790 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:33:18.863 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T11:33:18.864 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T11:33:18.998 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-10T11:33:18.999 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-10T11:33:19.030 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:33:19.030 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:33:19.030 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:33:19.030 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:33:19.031 INFO:teuthology.orchestra.run.smithi112.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T11:33:19.031 INFO:teuthology.orchestra.run.smithi112.stdout: python2.7-minimal 2024-09-10T11:33:19.031 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:33:19.032 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-10T11:33:19.032 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T11:33:19.032 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T11:33:19.032 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T11:33:19.034 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-10T11:33:19.034 INFO:teuthology.orchestra.run.smithi112.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T11:33:19.034 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-10T11:33:19.034 INFO:teuthology.orchestra.run.smithi112.stdout: thermald 2024-09-10T11:33:19.083 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-10T11:33:19.084 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T11:33:19.084 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T11:33:19.084 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T11:33:19.085 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-10T11:33:19.086 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T11:33:19.170 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:33:19.170 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:33:19.170 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:33:19.171 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:33:19.171 INFO:teuthology.orchestra.run.smithi078.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T11:33:19.171 INFO:teuthology.orchestra.run.smithi078.stdout: python2.7-minimal 2024-09-10T11:33:19.171 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:33:19.172 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-10T11:33:19.172 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T11:33:19.172 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T11:33:19.173 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T11:33:19.174 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-10T11:33:19.174 INFO:teuthology.orchestra.run.smithi078.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T11:33:19.174 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-09-10T11:33:19.174 INFO:teuthology.orchestra.run.smithi078.stdout: thermald 2024-09-10T11:33:19.233 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-10T11:33:19.233 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T11:33:19.234 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T11:33:19.234 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T11:33:19.235 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-09-10T11:33:19.236 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T11:33:19.265 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T11:33:19.265 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 113 MB of archives. 2024-09-10T11:33:19.265 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T11:33:19.265 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T11:33:19.415 INFO:teuthology.orchestra.run.smithi078.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T11:33:19.416 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 113 MB of archives. 2024-09-10T11:33:19.416 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T11:33:19.416 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T11:33:20.686 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T11:33:20.816 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T11:33:21.041 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T11:33:21.231 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T11:33:23.264 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T11:33:23.264 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T11:33:23.265 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T11:33:23.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T11:33:23.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T11:33:23.418 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T11:33:23.609 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T11:33:23.690 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T11:33:23.873 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T11:33:23.959 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T11:33:24.089 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-10T11:33:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 113 MB in 5s (24.0 MB/s) 2024-09-10T11:33:24.469 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T11:33:24.521 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T11:33:26.456 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T11:33:26.460 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:26.625 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:26.630 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T11:33:26.637 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:26.926 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:28.827 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T11:33:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:28.941 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:29.385 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T11:33:29.397 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T11:33:29.406 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:29.418 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:29.463 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:29.498 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:29.971 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T11:33:29.991 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:30.029 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:36.224 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T11:33:36.350 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T11:33:36.641 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T11:33:36.745 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T11:33:36.924 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T11:33:37.048 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T11:33:37.049 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T11:33:37.070 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T11:33:37.114 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T11:33:37.424 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T11:33:37.552 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T11:33:37.839 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T11:33:37.850 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T11:33:37.880 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T11:33:42.988 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T11:33:43.025 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:43.062 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:43.838 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T11:33:43.876 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T11:33:43.921 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T11:33:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T11:33:46.065 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T11:33:46.745 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:47.105 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T11:33:47.259 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:47.762 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T11:33:47.901 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T11:33:48.285 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T11:33:48.414 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:48.532 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T11:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T11:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T11:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T11:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T11:33:48.661 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:48.735 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:50.054 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T11:33:50.054 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T11:33:50.054 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T11:33:50.054 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T11:33:50.111 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:50.204 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:51.487 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T11:33:51.605 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T11:33:51.656 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:51.715 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:51.772 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T11:33:51.772 INFO:teuthology.orchestra.run.smithi112.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T11:33:53.307 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T11:33:53.458 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T11:33:53.584 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T11:33:53.653 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T11:33:53.653 INFO:teuthology.orchestra.run.smithi078.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T11:34:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T11:34:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub' 2024-09-10T11:34:05.936 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T11:34:05.961 INFO:teuthology.orchestra.run.smithi112.stdout:Generating grub configuration file ... 2024-09-10T11:34:06.239 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T11:34:06.255 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T11:34:06.542 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T11:34:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T11:34:06.617 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T11:34:06.622 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T11:34:06.779 INFO:teuthology.orchestra.run.smithi112.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T11:34:06.779 INFO:teuthology.orchestra.run.smithi112.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T11:34:06.779 INFO:teuthology.orchestra.run.smithi112.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T11:34:06.818 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-10T11:34:07.280 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-10T11:34:07.298 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.119.119 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-10T11:34:07.299 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-10T11:34:07.299 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T11:34:07.300 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T11:34:07.300 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T11:34:07.300 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-10T11:34:07.300 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T11:34:07.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-10T11:34:07.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-10T11:34:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T11:34:07.595 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T11:34:07.612 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T11:34:07.706 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T11:34:07.706 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub' 2024-09-10T11:34:07.707 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T11:34:07.722 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T11:34:07.743 INFO:teuthology.orchestra.run.smithi078.stdout:Generating grub configuration file ... 2024-09-10T11:34:08.056 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T11:34:08.077 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T11:34:08.412 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T11:34:08.417 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T11:34:08.491 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T11:34:08.497 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T11:34:08.677 INFO:teuthology.orchestra.run.smithi078.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T11:34:08.677 INFO:teuthology.orchestra.run.smithi078.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T11:34:08.677 INFO:teuthology.orchestra.run.smithi078.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T11:34:08.720 INFO:teuthology.orchestra.run.smithi078.stdout:done 2024-09-10T11:34:08.980 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:34:08.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T11:34:09.051 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:34:09.230 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-09-10T11:34:09.235 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T11:34:09.236 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T11:34:09.246 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-09-10T11:34:09.246 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-09-10T11:34:09.246 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-09-10T11:34:09.246 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.119.119 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-09-10T11:34:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-09-10T11:34:09.247 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T11:34:09.248 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T11:34:09.248 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T11:34:09.248 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T11:34:09.248 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T11:34:09.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-09-10T11:34:09.403 INFO:teuthology.orchestra.run.smithi112.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T11:34:09.403 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:34:09.403 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:34:09.403 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:34:09.404 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:34:09.404 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T11:34:09.404 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T11:34:09.404 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:34:09.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-10T11:34:09.442 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T11:34:09.444 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-10T11:34:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-10T11:34:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-10T11:34:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-10T11:34:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-10T11:34:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.119.119 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-10T11:34:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-10T11:34:09.502 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-10T11:34:09.545 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.kLDJuxYmPK 2024-09-10T11:34:09.545 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kLDJuxYmPK 2024-09-10T11:34:09.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.kLDJuxYmPK 2024-09-10T11:34:09.683 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T11:34:09.683 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T11:34:09.719 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.kLDJuxYmPK is 10KB 2024-09-10T11:34:09.733 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.kLDJuxYmPK 2024-09-10T11:34:09.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T11:34:09.755 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T11:34:09.794 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:34:09.794 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T11:34:09.794 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T11:34:09.837 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T11:34:09.863 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T11:34:09.863 DEBUG:teuthology.orchestra.run.smithi112:> sudo update-grub 2024-09-10T11:34:11.092 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-09-10T11:34:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T11:34:11.097 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-10T11:34:11.143 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:34:11.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T11:34:11.226 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:34:11.295 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T11:34:11.301 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T11:34:11.434 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-10T11:34:11.435 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-10T11:34:11.531 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T11:34:11.536 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T11:34:11.577 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T11:34:11.582 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T11:34:11.623 INFO:teuthology.orchestra.run.smithi078.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T11:34:11.623 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:34:11.624 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:34:11.624 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:34:11.624 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:34:11.624 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T11:34:11.624 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T11:34:11.624 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:34:11.666 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T11:34:11.668 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-09-10T11:34:11.680 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.119.119 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-09-10T11:34:11.681 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-09-10T11:34:11.682 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-09-10T11:34:11.682 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-10T11:34:11.698 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T11:34:11.698 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T11:34:11.698 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T11:34:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-10T11:34:11.715 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-10T11:34:11.727 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.Ms8YUdCKn5 2024-09-10T11:34:11.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ms8YUdCKn5 2024-09-10T11:34:11.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.Ms8YUdCKn5 2024-09-10T11:34:11.895 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.Ms8YUdCKn5 is 10KB 2024-09-10T11:34:11.907 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.Ms8YUdCKn5 2024-09-10T11:34:11.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T11:34:11.968 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:34:11.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T11:34:11.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T11:34:12.052 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T11:34:12.052 DEBUG:teuthology.orchestra.run.smithi078:> sudo update-grub 2024-09-10T11:34:13.435 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2024-09-10T11:34:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T11:34:13.440 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-10T11:34:13.652 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T11:34:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T11:34:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T11:34:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T11:34:13.937 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T11:34:13.942 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T11:34:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T11:34:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T11:34:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T11:34:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-10T11:34:14.088 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-10T11:34:41.737 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T11:34:41.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:34:41.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:34:44.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T11:34:44.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:34:44.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:00.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-10T11:35:02.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-10T11:35:09.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:35:09.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:11.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:35:11.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:12.221 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-10T11:35:14.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-10T11:35:24.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:35:24.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:26.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:35:26.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:42.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-10T11:35:44.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-10T11:35:57.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:35:57.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:57.891 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-10T11:35:58.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:35:58.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-10T11:35:58.474 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-10T11:35:58.520 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-119-generic 2024-09-10T11:35:58.521 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T11:35:58.521 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T11:35:58.521 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T11:35:59.522 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T11:35:59.523 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T11:35:59.590 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-10T11:35:59.614 DEBUG:teuthology.parallel:result is None 2024-09-10T11:35:59.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:35:59.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:36:00.527 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-10T11:36:01.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:36:01.378 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T11:36:01.378 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-10T11:36:01.383 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-119-generic 2024-09-10T11:36:01.384 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T11:36:01.384 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T11:36:01.384 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T11:36:02.385 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T11:36:02.385 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T11:36:02.451 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-10T11:36:02.486 DEBUG:teuthology.parallel:result is None 2024-09-10T11:36:02.486 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T11:36:02.493 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T11:36:02.494 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:36:02.496 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:36:02.502 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T11:36:02.508 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T11:36:02.518 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T11:36:02.518 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:36:02.541 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:36:02.617 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T11:36:02.624 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T11:36:02.624 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:36:02.626 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:36:02.646 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:36:02.646 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:36:02.654 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:36:02.654 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:36:02.656 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T11:36:02.665 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T11:36:02.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:36:02.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:36:02.723 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T11:36:02.732 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T11:36:02.733 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:36:02.765 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:36:02.771 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:36:02.816 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:36:02.868 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:36:02.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:36:02.947 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:36:02.953 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:36:03.001 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:36:03.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:36:03.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-10T11:36:03.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-10T11:36:03.138 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T11:36:03.146 INFO:teuthology.task.internal:Starting timer... 2024-09-10T11:36:03.146 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T11:36:03.156 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T11:36:03.164 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2024-09-10T11:36:03.164 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-09-10T11:36:03.164 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T11:36:03.165 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T11:36:03.165 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T11:36:03.165 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T11:36:03.176 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T11:36:03.187 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T11:36:03.188 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T11:43:29.843 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-09-10T11:43:29.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:43:29.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:43:29.944 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-10T11:43:30.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T11:43:30.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:43:30.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:43:30.104 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-10T11:43:30.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T11:43:30.181 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T11:43:30.191 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T11:43:30.191 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:43:30.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:43:30.194 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:43:30.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Command line: ntpd -gq 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: ---------------------------------------------------- 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: corporation. Support and training for ntp-4 are 2024-09-10T11:43:30.220 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: available at https://www.nwtime.org/support 2024-09-10T11:43:30.221 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: ---------------------------------------------------- 2024-09-10T11:43:30.221 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: proto: precision = 0.060 usec (-24) 2024-09-10T11:43:30.221 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: basedate set to 2022-02-04 2024-09-10T11:43:30.221 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: gps base set to 2022-02-06 (week 2196) 2024-09-10T11:43:30.222 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T11:43:30.222 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T11:43:30.222 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T11:43:30.222 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T11:43:30.223 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T11:43:30.223 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T11:43:30.224 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T11:43:30.224 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2024-09-10T11:43:30.224 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listen normally on 4 lo [::1]:123 2024-09-10T11:43:30.224 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2024-09-10T11:43:30.224 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:30 ntpd[18415]: Listening on routing socket on fd #22 for interface updates 2024-09-10T11:43:30.249 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T11:43:30.249 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Command line: ntpd -gq 2024-09-10T11:43:30.249 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: ---------------------------------------------------- 2024-09-10T11:43:30.249 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T11:43:30.249 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T11:43:30.250 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: corporation. Support and training for ntp-4 are 2024-09-10T11:43:30.250 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: available at https://www.nwtime.org/support 2024-09-10T11:43:30.250 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: ---------------------------------------------------- 2024-09-10T11:43:30.250 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: proto: precision = 0.043 usec (-24) 2024-09-10T11:43:30.250 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: basedate set to 2022-02-04 2024-09-10T11:43:30.251 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: gps base set to 2022-02-06 (week 2196) 2024-09-10T11:43:30.251 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T11:43:30.251 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T11:43:30.251 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T11:43:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listen normally on 4 lo [::1]:123 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-09-10T11:43:30.253 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:30 ntpd[18431]: Listening on routing socket on fd #22 for interface updates 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:31.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:31 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:31.250 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:31 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:31.250 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:31 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:31.250 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:31 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:31.250 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:31 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:31.250 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:31 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:31.250 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:31 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:33 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:33 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:33 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:33 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:33 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:33 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:33.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.254 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.255 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:33.255 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:33.255 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:33.255 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:33.255 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:33.256 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:33 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:34 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:34 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:34 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:34 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:34 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:34 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:35 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:35.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:35.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:35.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:35 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:36 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:36 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:36 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:36 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:36 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:36 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:37.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:37.222 INFO:teuthology.orchestra.run.smithi078.stdout:10 Sep 11:43:37 ntpd[18415]: ntpd: time slew -0.001083 s 2024-09-10T11:43:37.222 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.001083s 2024-09-10T11:43:37.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T11:43:37.222 INFO:teuthology.orchestra.run.smithi078.stderr:10 Sep 11:43:37 ntpd[18415]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 11:43:37 ntpd[18431]: ntpd: time slew -0.001336 s 2024-09-10T11:43:37.252 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew -0.001336s 2024-09-10T11:43:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T11:43:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 11:43:37 ntpd[18431]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T11:43:37.269 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T11:43:37.269 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-09-10T11:43:37.269 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.269 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.269 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.269 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T11:43:37.306 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-10T11:43:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T11:43:37.307 INFO:teuthology.run_tasks:Running task install... 2024-09-10T11:43:37.315 DEBUG:teuthology.task.install:project ceph 2024-09-10T11:43:37.315 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}} 2024-09-10T11:43:37.315 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'} 2024-09-10T11:43:37.315 INFO:teuthology.task.install:Using flavor: default 2024-09-10T11:43:37.321 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T11:43:37.321 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T11:43:37.322 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2024-09-10T11:43:37.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-09-10T11:43:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T11:43:37.406 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T11:43:37.412 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T11:43:37.412 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T11:43:37.413 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-10T11:43:37.413 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-10T11:43:37.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:43:37.433 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T11:43:37.433 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T11:43:37.434 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-10T11:43:37.434 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-10T11:43:37.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:43:37.554 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default/ 2024-09-10T11:43:37.555 INFO:teuthology.task.install.deb:Package version is 19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:43:37.575 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default/ 2024-09-10T11:43:37.575 INFO:teuthology.task.install.deb:Package version is 19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:43:37.666 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:43:37.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T11:43:37.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-10T11:43:37.687 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:43:37.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T11:43:37.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-10T11:43:37.903 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T11:43:37.925 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T11:43:37.929 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T11:43:37.948 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T11:43:37.951 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T11:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T11:43:37.977 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T11:43:37.977 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T11:43:37.978 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T11:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T11:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T11:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T11:43:38.006 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-10T11:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-10T11:43:38.050 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T11:43:38.074 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T11:43:38.131 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T11:43:38.155 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T11:43:38.341 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 29.3 kB in 0s (61.1 kB/s) 2024-09-10T11:43:38.362 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 29.3 kB in 0s (61.3 kB/s) 2024-09-10T11:43:39.371 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:43:39.386 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4704-g8b38c33c-1jammy cephadm=19.3.0-4704-g8b38c33c-1jammy ceph-mds=19.3.0-4704-g8b38c33c-1jammy ceph-mgr=19.3.0-4704-g8b38c33c-1jammy ceph-common=19.3.0-4704-g8b38c33c-1jammy ceph-fuse=19.3.0-4704-g8b38c33c-1jammy ceph-test=19.3.0-4704-g8b38c33c-1jammy ceph-volume=19.3.0-4704-g8b38c33c-1jammy radosgw=19.3.0-4704-g8b38c33c-1jammy python3-rados=19.3.0-4704-g8b38c33c-1jammy python3-rgw=19.3.0-4704-g8b38c33c-1jammy python3-cephfs=19.3.0-4704-g8b38c33c-1jammy python3-rbd=19.3.0-4704-g8b38c33c-1jammy libcephfs2=19.3.0-4704-g8b38c33c-1jammy libcephfs-dev=19.3.0-4704-g8b38c33c-1jammy librados2=19.3.0-4704-g8b38c33c-1jammy librbd1=19.3.0-4704-g8b38c33c-1jammy rbd-fuse=19.3.0-4704-g8b38c33c-1jammy python3-cephfs=19.3.0-4704-g8b38c33c-1jammy cephfs-shell=19.3.0-4704-g8b38c33c-1jammy cephfs-top=19.3.0-4704-g8b38c33c-1jammy cephfs-mirror=19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:43:39.390 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:43:39.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4704-g8b38c33c-1jammy cephadm=19.3.0-4704-g8b38c33c-1jammy ceph-mds=19.3.0-4704-g8b38c33c-1jammy ceph-mgr=19.3.0-4704-g8b38c33c-1jammy ceph-common=19.3.0-4704-g8b38c33c-1jammy ceph-fuse=19.3.0-4704-g8b38c33c-1jammy ceph-test=19.3.0-4704-g8b38c33c-1jammy ceph-volume=19.3.0-4704-g8b38c33c-1jammy radosgw=19.3.0-4704-g8b38c33c-1jammy python3-rados=19.3.0-4704-g8b38c33c-1jammy python3-rgw=19.3.0-4704-g8b38c33c-1jammy python3-cephfs=19.3.0-4704-g8b38c33c-1jammy python3-rbd=19.3.0-4704-g8b38c33c-1jammy libcephfs2=19.3.0-4704-g8b38c33c-1jammy libcephfs-dev=19.3.0-4704-g8b38c33c-1jammy librados2=19.3.0-4704-g8b38c33c-1jammy librbd1=19.3.0-4704-g8b38c33c-1jammy rbd-fuse=19.3.0-4704-g8b38c33c-1jammy python3-cephfs=19.3.0-4704-g8b38c33c-1jammy cephfs-shell=19.3.0-4704-g8b38c33c-1jammy cephfs-top=19.3.0-4704-g8b38c33c-1jammy cephfs-mirror=19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:43:39.439 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:43:39.472 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:43:39.622 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T11:43:39.623 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T11:43:39.681 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-10T11:43:39.681 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-10T11:43:39.806 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:43:39.806 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:43:39.806 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:43:39.806 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:43:39.807 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T11:43:39.807 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T11:43:39.807 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:43:39.808 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-10T11:43:39.808 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T11:43:39.808 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T11:43:39.808 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T11:43:39.808 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-10T11:43:39.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-10T11:43:39.810 INFO:teuthology.orchestra.run.smithi112.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-10T11:43:39.811 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-09-10T11:43:39.879 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:43:39.879 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:43:39.879 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:43:39.879 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:43:39.880 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T11:43:39.880 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T11:43:39.880 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:43:39.881 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-10T11:43:39.881 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T11:43:39.881 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T11:43:39.881 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T11:43:39.881 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-10T11:43:39.882 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-10T11:43:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-09-10T11:43:39.884 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2024-09-10T11:43:39.917 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-10T11:43:39.917 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T11:43:39.917 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T11:43:39.918 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-10T11:43:39.918 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-10T11:43:39.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T11:43:39.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T11:43:39.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-10T11:43:39.922 INFO:teuthology.orchestra.run.smithi112.stdout: socat unzip xmlstarlet zip 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-10T11:43:39.995 INFO:teuthology.orchestra.run.smithi078.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-10T11:43:39.996 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T11:43:39.997 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T11:43:39.997 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T11:43:39.997 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T11:43:39.997 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-10T11:43:39.997 INFO:teuthology.orchestra.run.smithi078.stdout: socat unzip xmlstarlet zip 2024-09-10T11:43:40.061 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T11:43:40.061 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 251 MB of archives. 2024-09-10T11:43:40.062 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 935 MB of additional disk space will be used. 2024-09-10T11:43:40.062 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4704-g8b38c33c-1jammy [3,630 kB] 2024-09-10T11:43:40.105 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-10T11:43:40.139 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T11:43:40.139 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 251 MB of archives. 2024-09-10T11:43:40.139 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 935 MB of additional disk space will be used. 2024-09-10T11:43:40.139 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4704-g8b38c33c-1jammy [3,630 kB] 2024-09-10T11:43:40.186 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-10T11:43:40.187 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T11:43:40.233 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-10T11:43:40.242 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4704-g8b38c33c-1jammy [3,321 kB] 2024-09-10T11:43:40.269 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T11:43:40.315 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-10T11:43:40.321 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4704-g8b38c33c-1jammy [722 kB] 2024-09-10T11:43:40.340 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4704-g8b38c33c-1jammy [356 kB] 2024-09-10T11:43:40.352 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4704-g8b38c33c-1jammy [32.8 kB] 2024-09-10T11:43:40.353 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4704-g8b38c33c-1jammy [180 kB] 2024-09-10T11:43:40.358 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4704-g8b38c33c-1jammy [71.7 kB] 2024-09-10T11:43:40.359 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4704-g8b38c33c-1jammy [338 kB] 2024-09-10T11:43:40.366 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4704-g8b38c33c-1jammy [7,979 kB] 2024-09-10T11:43:40.391 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4704-g8b38c33c-1jammy [3,321 kB] 2024-09-10T11:43:40.427 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T11:43:40.511 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T11:43:40.517 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4704-g8b38c33c-1jammy [722 kB] 2024-09-10T11:43:40.519 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T11:43:40.532 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T11:43:40.532 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4704-g8b38c33c-1jammy [356 kB] 2024-09-10T11:43:40.539 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4704-g8b38c33c-1jammy [32.8 kB] 2024-09-10T11:43:40.541 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4704-g8b38c33c-1jammy [180 kB] 2024-09-10T11:43:40.545 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4704-g8b38c33c-1jammy [71.7 kB] 2024-09-10T11:43:40.547 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4704-g8b38c33c-1jammy [338 kB] 2024-09-10T11:43:40.553 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4704-g8b38c33c-1jammy [7,979 kB] 2024-09-10T11:43:40.581 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T11:43:40.583 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4704-g8b38c33c-1jammy [112 kB] 2024-09-10T11:43:40.585 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4704-g8b38c33c-1jammy [473 kB] 2024-09-10T11:43:40.603 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T11:43:40.615 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T11:43:40.619 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4704-g8b38c33c-1jammy [28.2 MB] 2024-09-10T11:43:40.665 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T11:43:40.758 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T11:43:40.763 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T11:43:40.789 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T11:43:40.798 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T11:43:40.799 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T11:43:40.817 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T11:43:40.821 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T11:43:40.825 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T11:43:40.828 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T11:43:40.843 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T11:43:40.843 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T11:43:40.860 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T11:43:40.861 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4704-g8b38c33c-1jammy [112 kB] 2024-09-10T11:43:40.863 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4704-g8b38c33c-1jammy [473 kB] 2024-09-10T11:43:40.878 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T11:43:40.885 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T11:43:40.886 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T11:43:40.904 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T11:43:40.906 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T11:43:40.911 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T11:43:40.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T11:43:40.913 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T11:43:40.915 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T11:43:40.918 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T11:43:40.919 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T11:43:40.920 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T11:43:40.926 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T11:43:40.927 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T11:43:40.927 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T11:43:40.928 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T11:43:40.928 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T11:43:40.955 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4704-g8b38c33c-1jammy [28.2 MB] 2024-09-10T11:43:40.995 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T11:43:41.000 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T11:43:41.003 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T11:43:41.005 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T11:43:41.006 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T11:43:41.006 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T11:43:41.007 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T11:43:41.007 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T11:43:41.009 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T11:43:41.010 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T11:43:41.011 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T11:43:41.011 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T11:43:41.013 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T11:43:41.014 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T11:43:41.087 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T11:43:41.088 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T11:43:41.089 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T11:43:41.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T11:43:41.090 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T11:43:41.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T11:43:41.091 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T11:43:41.091 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T11:43:41.096 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T11:43:41.097 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T11:43:41.169 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T11:43:41.170 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T11:43:41.171 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T11:43:41.171 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T11:43:41.172 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T11:43:41.173 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T11:43:41.174 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T11:43:41.175 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T11:43:41.182 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T11:43:41.182 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T11:43:41.250 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T11:43:41.251 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T11:43:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T11:43:41.253 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T11:43:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T11:43:41.255 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T11:43:41.257 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T11:43:41.259 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T11:43:41.266 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T11:43:41.267 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T11:43:41.331 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T11:43:41.332 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T11:43:41.334 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T11:43:41.335 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T11:43:41.337 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T11:43:41.338 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T11:43:41.339 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T11:43:41.340 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T11:43:41.342 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T11:43:41.344 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T11:43:41.412 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T11:43:41.415 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T11:43:41.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T11:43:41.422 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T11:43:41.423 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T11:43:41.425 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T11:43:41.497 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T11:43:41.647 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4704-g8b38c33c-1jammy [5,203 kB] 2024-09-10T11:43:41.647 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T11:43:41.649 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T11:43:41.652 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T11:43:41.653 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T11:43:41.655 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T11:43:41.664 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T11:43:41.666 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T11:43:41.668 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T11:43:41.669 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T11:43:41.671 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T11:43:41.700 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T11:43:41.703 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T11:43:41.704 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T11:43:41.708 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T11:43:41.711 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T11:43:41.712 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T11:43:41.731 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4704-g8b38c33c-1jammy [252 kB] 2024-09-10T11:43:41.736 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4704-g8b38c33c-1jammy [124 kB] 2024-09-10T11:43:41.738 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4704-g8b38c33c-1jammy [1,561 kB] 2024-09-10T11:43:41.772 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T11:43:41.773 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T11:43:41.791 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4704-g8b38c33c-1jammy [6,310 kB] 2024-09-10T11:43:41.813 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T11:43:41.814 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T11:43:41.816 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T11:43:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T11:43:41.818 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T11:43:41.819 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T11:43:41.828 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T11:43:41.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T11:43:41.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T11:43:41.835 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T11:43:41.895 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T11:43:41.898 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T11:43:41.900 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T11:43:41.915 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T11:43:41.916 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4704-g8b38c33c-1jammy [5,203 kB] 2024-09-10T11:43:41.916 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T11:43:41.917 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T11:43:41.918 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T11:43:41.919 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T11:43:41.926 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T11:43:41.930 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T11:43:41.938 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4704-g8b38c33c-1jammy [23.1 MB] 2024-09-10T11:43:41.976 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T11:43:41.982 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-10T11:43:41.984 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T11:43:41.986 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T11:43:41.987 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T11:43:41.996 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4704-g8b38c33c-1jammy [252 kB] 2024-09-10T11:43:41.997 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T11:43:41.999 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T11:43:42.000 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T11:43:42.002 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4704-g8b38c33c-1jammy [124 kB] 2024-09-10T11:43:42.008 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4704-g8b38c33c-1jammy [1,561 kB] 2024-09-10T11:43:42.015 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T11:43:42.024 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T11:43:42.031 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-10T11:43:42.032 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T11:43:42.034 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T11:43:42.035 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T11:43:42.057 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T11:43:42.057 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T11:43:42.059 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T11:43:42.060 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4704-g8b38c33c-1jammy [6,310 kB] 2024-09-10T11:43:42.090 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T11:43:42.092 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T11:43:42.099 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T11:43:42.138 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T11:43:42.142 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T11:43:42.144 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T11:43:42.160 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T11:43:42.161 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T11:43:42.162 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T11:43:42.162 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T11:43:42.163 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T11:43:42.163 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T11:43:42.167 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T11:43:42.168 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T11:43:42.169 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T11:43:42.186 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T11:43:42.219 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T11:43:42.242 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T11:43:42.242 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T11:43:42.248 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T11:43:42.250 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T11:43:42.271 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4704-g8b38c33c-1jammy [23.1 MB] 2024-09-10T11:43:42.749 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4704-g8b38c33c-1jammy [14.1 kB] 2024-09-10T11:43:42.749 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [880 kB] 2024-09-10T11:43:42.767 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4704-g8b38c33c-1jammy [2,437 kB] 2024-09-10T11:43:42.807 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4704-g8b38c33c-1jammy [812 kB] 2024-09-10T11:43:42.816 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4704-g8b38c33c-1jammy [160 kB] 2024-09-10T11:43:42.818 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4704-g8b38c33c-1jammy [61.4 MB] 2024-09-10T11:43:43.118 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4704-g8b38c33c-1jammy [14.1 kB] 2024-09-10T11:43:43.119 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [880 kB] 2024-09-10T11:43:43.136 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4704-g8b38c33c-1jammy [2,437 kB] 2024-09-10T11:43:43.177 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4704-g8b38c33c-1jammy [812 kB] 2024-09-10T11:43:43.196 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4704-g8b38c33c-1jammy [160 kB] 2024-09-10T11:43:43.199 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4704-g8b38c33c-1jammy [61.4 MB] 2024-09-10T11:43:45.041 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4704-g8b38c33c-1jammy [8,625 kB] 2024-09-10T11:43:45.208 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4704-g8b38c33c-1jammy [14.2 kB] 2024-09-10T11:43:45.209 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4704-g8b38c33c-1jammy [55.7 MB] 2024-09-10T11:43:45.339 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4704-g8b38c33c-1jammy [8,625 kB] 2024-09-10T11:43:45.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4704-g8b38c33c-1jammy [14.2 kB] 2024-09-10T11:43:45.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4704-g8b38c33c-1jammy [55.7 MB] 2024-09-10T11:43:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4704-g8b38c33c-1jammy [130 kB] 2024-09-10T11:43:47.312 INFO:teuthology.orchestra.run.smithi112.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4704-g8b38c33c-1jammy [233 kB] 2024-09-10T11:43:47.317 INFO:teuthology.orchestra.run.smithi112.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4704-g8b38c33c-1jammy [33.9 kB] 2024-09-10T11:43:47.318 INFO:teuthology.orchestra.run.smithi112.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4704-g8b38c33c-1jammy [23.4 kB] 2024-09-10T11:43:47.319 INFO:teuthology.orchestra.run.smithi112.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4704-g8b38c33c-1jammy [39.0 kB] 2024-09-10T11:43:47.320 INFO:teuthology.orchestra.run.smithi112.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4704-g8b38c33c-1jammy [15.9 MB] 2024-09-10T11:43:47.497 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4704-g8b38c33c-1jammy [130 kB] 2024-09-10T11:43:47.500 INFO:teuthology.orchestra.run.smithi078.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4704-g8b38c33c-1jammy [233 kB] 2024-09-10T11:43:47.504 INFO:teuthology.orchestra.run.smithi078.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4704-g8b38c33c-1jammy [33.9 kB] 2024-09-10T11:43:47.505 INFO:teuthology.orchestra.run.smithi078.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4704-g8b38c33c-1jammy [23.4 kB] 2024-09-10T11:43:47.540 INFO:teuthology.orchestra.run.smithi078.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4704-g8b38c33c-1jammy [39.0 kB] 2024-09-10T11:43:47.541 INFO:teuthology.orchestra.run.smithi078.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4704-g8b38c33c-1jammy [15.9 MB] 2024-09-10T11:43:47.634 INFO:teuthology.orchestra.run.smithi112.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [91.3 kB] 2024-09-10T11:43:47.850 INFO:teuthology.orchestra.run.smithi078.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [91.3 kB] 2024-09-10T11:43:48.304 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 251 MB in 8s (32.6 MB/s) 2024-09-10T11:43:48.449 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-10T11:43:48.478 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 251 MB in 8s (32.0 MB/s) 2024-09-10T11:43:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T11:43:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-10T11:43:48.597 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-10T11:43:48.651 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-10T11:43:48.731 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T11:43:48.736 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-10T11:43:48.782 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-10T11:43:48.900 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T11:43:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T11:43:48.966 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T11:43:49.152 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T11:43:49.179 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T11:43:49.227 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T11:43:49.261 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cmd2. 2024-09-10T11:43:49.287 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-10T11:43:49.327 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-10T11:43:49.614 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2024-09-10T11:43:49.640 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-10T11:43:49.672 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T11:43:49.688 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-10T11:43:49.698 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T11:43:49.781 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T11:43:50.067 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T11:43:50.093 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T11:43:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T11:43:50.152 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T11:43:50.175 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T11:43:50.192 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T11:43:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T11:43:50.504 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T11:43:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T11:43:50.530 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T11:43:50.545 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T11:43:50.570 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T11:43:50.874 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T11:43:50.900 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T11:43:50.940 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T11:43:50.958 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T11:43:50.984 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T11:43:51.033 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:43:51.419 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T11:43:51.445 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T11:43:51.452 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T11:43:51.478 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T11:43:51.494 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:43:51.519 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:43:51.813 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T11:43:51.837 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T11:43:51.855 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T11:43:51.871 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T11:43:51.880 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:43:51.914 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:43:52.242 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T11:43:52.250 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T11:43:52.268 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T11:43:52.276 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T11:43:52.308 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T11:43:52.317 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:43:52.628 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-09-10T11:43:52.654 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-librados2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:52.687 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T11:43:52.694 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:52.713 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T11:43:52.754 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T11:43:53.040 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2024-09-10T11:43:53.063 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-librados2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:53.098 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:53.149 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-09-10T11:43:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-librbd1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:53.759 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2024-09-10T11:43:53.786 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librbd1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:53.834 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:53.925 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T11:43:53.951 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-libcephfs2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:53.991 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:54.277 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-09-10T11:43:54.279 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T11:43:54.304 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-rados_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:54.305 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-libcephfs2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:54.344 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:54.345 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:54.615 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2024-09-10T11:43:54.630 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-rados_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:54.647 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T11:43:54.665 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:54.673 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:43:54.705 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:54.907 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T11:43:54.923 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-cephfs_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:54.986 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:55.285 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T11:43:55.303 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T11:43:55.311 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-ceph-common_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:43:55.319 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-cephfs_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:55.351 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:55.673 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T11:43:55.700 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-ceph-common_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:43:55.705 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T11:43:55.731 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T11:43:55.739 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:55.771 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T11:43:56.024 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T11:43:56.050 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-python3-rbd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:56.068 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T11:43:56.090 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:56.094 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T11:43:56.134 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T11:43:56.387 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T11:43:56.394 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T11:43:56.403 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-rbd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:56.426 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T11:43:56.445 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:56.696 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T11:43:56.711 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T11:43:56.754 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T11:43:56.774 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T11:43:56.800 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T11:43:56.832 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T11:43:57.049 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T11:43:57.065 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T11:43:57.101 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T11:43:57.107 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T11:43:57.117 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T11:43:57.159 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T11:43:57.427 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-09-10T11:43:57.453 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T11:43:57.471 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T11:43:57.493 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T11:43:57.498 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T11:43:57.537 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T11:43:57.797 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-09-10T11:43:57.823 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-10T11:43:57.863 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T11:43:57.883 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua5.1. 2024-09-10T11:43:57.909 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T11:43:57.949 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T11:43:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-09-10T11:43:58.097 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-10T11:43:58.140 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T11:43:58.261 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-any. 2024-09-10T11:43:58.276 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-10T11:43:58.319 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T11:43:58.486 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-09-10T11:43:58.512 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T11:43:58.552 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T11:43:58.589 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package zip. 2024-09-10T11:43:58.615 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-10T11:43:58.655 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T11:43:58.948 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-09-10T11:43:58.974 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T11:43:59.014 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T11:43:59.035 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package unzip. 2024-09-10T11:43:59.060 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T11:43:59.100 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T11:43:59.372 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-09-10T11:43:59.387 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-librgw2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:59.422 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:43:59.454 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package luarocks. 2024-09-10T11:43:59.481 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T11:43:59.521 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T11:43:59.904 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2024-09-10T11:43:59.931 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-librgw2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:43:59.971 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T11:44:00.031 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-python3-rgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:00.074 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:00.411 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T11:44:00.438 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T11:44:00.477 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T11:44:00.590 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T11:44:00.616 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-rgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:00.657 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:00.755 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T11:44:00.782 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-libradosstriper1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:00.822 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:00.951 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T11:44:00.964 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T11:44:01.001 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T11:44:01.225 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-09-10T11:44:01.252 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-ceph-common_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:01.292 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:01.321 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-libradosstriper1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:01.388 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:01.825 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2024-09-10T11:44:01.851 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-ceph-common_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:01.891 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-09-10T11:44:03.113 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-ceph-base_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:03.113 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:03.372 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2024-09-10T11:44:03.398 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-ceph-base_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:03.410 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T11:44:03.437 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T11:44:03.447 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:03.593 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T11:44:03.896 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T11:44:03.922 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T11:44:03.962 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T11:44:04.243 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T11:44:04.269 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T11:44:04.291 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T11:44:04.309 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T11:44:04.317 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T11:44:04.357 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T11:44:04.621 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T11:44:04.626 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T11:44:04.647 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T11:44:04.653 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T11:44:04.685 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T11:44:04.687 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T11:44:04.962 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T11:44:04.989 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T11:44:05.024 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T11:44:05.029 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T11:44:05.050 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T11:44:05.090 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T11:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T11:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T11:44:05.393 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T11:44:05.407 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T11:44:05.419 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T11:44:05.459 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T11:44:05.710 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-09-10T11:44:05.736 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-10T11:44:05.738 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T11:44:05.764 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T11:44:05.776 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T11:44:05.796 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T11:44:06.046 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T11:44:06.072 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T11:44:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T11:44:06.106 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T11:44:06.112 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T11:44:06.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T11:44:06.424 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T11:44:06.450 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T11:44:06.451 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2024-09-10T11:44:06.478 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-10T11:44:06.490 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T11:44:06.518 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T11:44:06.827 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T11:44:06.838 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T11:44:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T11:44:06.864 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T11:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T11:44:06.905 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T11:44:07.147 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T11:44:07.149 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T11:44:07.162 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T11:44:07.176 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T11:44:07.216 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T11:44:07.222 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T11:44:07.525 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T11:44:07.552 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T11:44:07.578 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T11:44:07.591 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T11:44:07.605 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T11:44:07.645 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T11:44:07.894 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-09-10T11:44:07.914 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T11:44:07.921 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T11:44:07.929 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T11:44:07.960 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T11:44:07.964 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T11:44:08.267 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T11:44:08.281 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T11:44:08.294 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T11:44:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T11:44:08.334 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T11:44:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T11:44:08.604 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2024-09-10T11:44:08.626 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T11:44:08.650 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T11:44:08.662 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T11:44:08.677 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T11:44:08.717 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T11:44:08.969 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-09-10T11:44:08.982 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T11:44:08.993 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T11:44:09.008 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T11:44:09.027 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T11:44:09.049 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T11:44:09.351 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T11:44:09.364 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T11:44:09.378 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T11:44:09.391 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T11:44:09.418 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T11:44:09.433 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T11:44:09.688 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2024-09-10T11:44:09.714 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T11:44:09.742 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T11:44:09.754 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T11:44:09.769 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T11:44:09.808 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T11:44:10.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T11:44:10.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T11:44:10.111 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-09-10T11:44:10.138 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T11:44:10.152 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T11:44:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T11:44:10.436 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T11:44:10.462 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T11:44:10.481 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T11:44:10.502 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T11:44:10.508 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T11:44:10.548 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T11:44:10.839 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2024-09-10T11:44:10.850 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T11:44:10.866 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T11:44:10.878 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T11:44:10.905 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T11:44:10.917 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T11:44:11.212 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T11:44:11.225 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T11:44:11.239 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T11:44:11.240 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T11:44:11.274 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T11:44:11.278 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T11:44:11.586 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T11:44:11.598 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T11:44:11.612 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T11:44:11.625 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T11:44:11.652 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T11:44:11.665 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T11:44:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T11:44:11.983 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T11:44:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T11:44:12.028 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T11:44:12.055 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T11:44:12.094 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T11:44:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T11:44:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T11:44:12.381 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-09-10T11:44:12.396 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T11:44:12.400 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T11:44:12.439 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T11:44:12.750 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T11:44:12.764 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T11:44:12.777 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T11:44:12.779 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T11:44:12.816 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T11:44:12.822 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T11:44:13.802 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-09-10T11:44:13.809 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2024-09-10T11:44:13.829 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T11:44:13.836 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T11:44:14.076 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T11:44:14.179 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T11:44:14.429 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T11:44:14.456 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T11:44:14.490 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T11:44:14.495 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T11:44:14.517 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T11:44:14.832 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2024-09-10T11:44:14.859 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T11:44:14.859 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T11:44:14.875 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:14.915 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T11:44:14.926 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:15.218 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T11:44:15.245 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T11:44:15.276 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T11:44:15.306 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T11:44:15.333 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:15.373 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:15.572 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T11:44:15.587 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:15.622 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:15.684 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T11:44:15.711 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T11:44:15.750 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T11:44:15.993 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T11:44:15.994 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T11:44:16.010 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T11:44:16.019 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:16.045 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T11:44:16.059 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:16.346 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T11:44:16.372 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T11:44:16.381 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T11:44:16.408 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-mgr_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:16.412 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T11:44:16.448 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:16.716 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T11:44:16.742 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T11:44:16.782 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T11:44:16.834 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T11:44:16.861 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph-mon_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:16.901 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:17.119 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T11:44:17.145 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-ceph-mgr_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:17.185 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:17.463 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T11:44:17.489 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph-osd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:17.521 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:17.664 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T11:44:17.690 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph-mon_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:17.739 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:18.426 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T11:44:18.452 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-ceph-osd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:18.492 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:18.566 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-09-10T11:44:18.581 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:18.624 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:18.960 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T11:44:18.986 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-ceph-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:19.026 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T11:44:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-ceph-mds_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:19.446 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:19.788 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2024-09-10T11:44:19.814 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:19.824 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-09-10T11:44:19.851 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-cephadm_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:19.891 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:20.210 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T11:44:20.232 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T11:44:20.237 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T11:44:20.258 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-ceph-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:20.276 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T11:44:20.306 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:20.562 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T11:44:20.578 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T11:44:20.621 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T11:44:20.743 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T11:44:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-ceph-mds_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:21.230 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2024-09-10T11:44:21.256 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-cephadm_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:21.296 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:21.584 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-09-10T11:44:21.611 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T11:44:21.615 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T11:44:21.642 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T11:44:21.650 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T11:44:21.682 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T11:44:21.997 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T11:44:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T11:44:22.017 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T11:44:22.037 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T11:44:22.093 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T11:44:22.382 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T11:44:22.408 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:22.448 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:22.818 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T11:44:22.845 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T11:44:22.885 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T11:44:23.149 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2024-09-10T11:44:23.176 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T11:44:23.188 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-09-10T11:44:23.214 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T11:44:23.215 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T11:44:23.246 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T11:44:23.552 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T11:44:23.579 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T11:44:23.582 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T11:44:23.609 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:23.618 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T11:44:23.649 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:23.940 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T11:44:23.967 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:23.998 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:24.310 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T11:44:24.337 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T11:44:24.368 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T11:44:24.671 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2024-09-10T11:44:24.698 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T11:44:24.737 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T11:44:25.091 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T11:44:25.118 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:25.157 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:26.545 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T11:44:26.573 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T11:44:26.612 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T11:44:27.109 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T11:44:27.136 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T11:44:27.175 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T11:44:27.537 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T11:44:27.565 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T11:44:27.689 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T11:44:27.780 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T11:44:27.797 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T11:44:27.838 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T11:44:27.992 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T11:44:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T11:44:28.059 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T11:44:28.358 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T11:44:28.386 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T11:44:28.425 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T11:44:28.726 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T11:44:28.742 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:28.776 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:28.845 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T11:44:28.873 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T11:44:29.006 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T11:44:29.334 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T11:44:29.362 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T11:44:29.409 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T11:44:29.704 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T11:44:29.732 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T11:44:29.770 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T11:44:30.074 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T11:44:30.101 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T11:44:30.140 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T11:44:30.169 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T11:44:30.197 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:30.235 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:30.502 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T11:44:30.530 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T11:44:30.569 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T11:44:30.880 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T11:44:30.907 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-10T11:44:30.946 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T11:44:31.189 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T11:44:31.216 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T11:44:31.226 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T11:44:31.253 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T11:44:31.255 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T11:44:31.283 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T11:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T11:44:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T11:44:31.570 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T11:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T11:44:31.598 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T11:44:31.636 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T11:44:31.853 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T11:44:31.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T11:44:31.911 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T11:44:31.948 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T11:44:31.975 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T11:44:32.014 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T11:44:32.148 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T11:44:32.164 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-10T11:44:32.206 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T11:44:32.326 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T11:44:32.354 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T11:44:32.392 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T11:44:32.535 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T11:44:32.563 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T11:44:32.601 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T11:44:32.921 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T11:44:32.949 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T11:44:32.988 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T11:44:33.015 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T11:44:33.043 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:33.073 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:33.241 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T11:44:33.269 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T11:44:33.299 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T11:44:33.409 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T11:44:33.861 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T11:44:33.861 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T11:44:33.861 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T11:44:33.861 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T11:44:33.861 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T11:44:33.862 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T11:44:33.862 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T11:44:33.878 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T11:44:34.148 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-09-10T11:44:34.164 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T11:44:34.206 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T11:44:34.425 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T11:44:34.450 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-09-10T11:44:34.454 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:34.466 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T11:44:34.500 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:34.508 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T11:44:34.962 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T11:44:34.989 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T11:44:35.004 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T11:44:35.019 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T11:44:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T11:44:35.062 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T11:44:35.383 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-09-10T11:44:35.399 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-ceph-test_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:35.441 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:35.623 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T11:44:35.650 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T11:44:35.689 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T11:44:35.958 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2024-09-10T11:44:35.974 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T11:44:36.017 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T11:44:36.270 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2024-09-10T11:44:36.298 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T11:44:36.336 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T11:44:36.631 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T11:44:36.647 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T11:44:36.689 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T11:44:37.052 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2024-09-10T11:44:37.080 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-ceph-test_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:37.118 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:37.862 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T11:44:37.890 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-ceph-volume_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:37.953 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:38.324 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-10T11:44:38.352 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-cephfs-mirror_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:38.390 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-mirror (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:38.694 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-colorama. 2024-09-10T11:44:38.722 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-10T11:44:38.760 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-10T11:44:39.021 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-shell. 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-cephfs-shell_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:39.079 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-shell (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:39.323 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-top. 2024-09-10T11:44:39.339 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-cephfs-top_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:39.373 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-top (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:39.601 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T11:44:39.625 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-libcephfs-dev_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:39.664 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T11:44:39.667 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:39.692 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-ceph-volume_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:39.731 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:39.970 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T11:44:39.998 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T11:44:40.037 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T11:44:40.094 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-10T11:44:40.122 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-cephfs-mirror_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:40.160 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:40.358 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T11:44:40.386 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T11:44:40.424 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T11:44:40.472 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2024-09-10T11:44:40.500 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-10T11:44:40.538 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-10T11:44:40.745 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T11:44:40.773 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T11:44:40.803 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T11:44:40.808 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2024-09-10T11:44:40.824 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-cephfs-shell_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:40.866 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:41.110 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2024-09-10T11:44:41.127 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-cephfs-top_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-10T11:44:41.161 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:41.192 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-09-10T11:44:41.220 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T11:44:41.266 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T11:44:41.430 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T11:44:41.446 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-libcephfs-dev_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:41.488 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:41.536 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T11:44:41.552 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T11:44:41.594 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T11:44:41.808 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T11:44:41.836 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T11:44:41.874 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T11:44:42.064 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T11:44:42.093 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T11:44:42.130 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T11:44:42.213 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T11:44:42.241 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T11:44:42.279 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T11:44:42.433 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T11:44:42.462 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T11:44:42.499 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T11:44:42.633 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T11:44:42.662 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T11:44:42.700 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T11:44:42.820 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T11:44:42.848 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T11:44:42.886 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T11:44:43.130 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pkg-config. 2024-09-10T11:44:43.158 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T11:44:43.164 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T11:44:43.181 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T11:44:43.197 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T11:44:43.214 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T11:44:43.475 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T11:44:43.491 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T11:44:43.533 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T11:44:43.550 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-09-10T11:44:43.566 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-10T11:44:43.600 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T11:44:43.904 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T11:44:43.932 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T11:44:43.962 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T11:44:43.978 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T11:44:44.006 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T11:44:44.045 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T11:44:44.306 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T11:44:44.322 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T11:44:44.364 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T11:44:44.399 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T11:44:44.427 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T11:44:44.457 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T11:44:44.676 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T11:44:44.704 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T11:44:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T11:44:44.760 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-09-10T11:44:44.788 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-10T11:44:44.827 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T11:44:45.054 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T11:44:45.077 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T11:44:45.130 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T11:44:45.137 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T11:44:45.161 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T11:44:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T11:44:45.474 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2024-09-10T11:44:45.502 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-10T11:44:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T11:44:45.540 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T11:44:45.544 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T11:44:45.602 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T11:44:45.861 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T11:44:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T11:44:45.889 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T11:44:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T11:44:45.927 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T11:44:45.935 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T11:44:46.407 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T11:44:46.435 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T11:44:46.473 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T11:44:46.656 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-09-10T11:44:46.685 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../122-radosgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:46.722 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:46.759 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2024-09-10T11:44:46.776 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-10T11:44:46.809 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T11:44:47.079 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T11:44:47.107 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T11:44:47.145 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T11:44:47.491 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T11:44:47.519 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T11:44:47.549 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T11:44:47.617 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T11:44:47.634 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../123-rbd-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:47.675 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:47.802 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T11:44:47.818 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T11:44:47.860 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T11:44:47.972 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T11:44:48.230 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T11:44:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T11:44:48.531 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2024-09-10T11:44:48.560 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../122-radosgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:48.589 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:48.614 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T11:44:48.911 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T11:44:49.349 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T11:44:49.417 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:49.484 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T11:44:49.501 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../123-rbd-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-10T11:44:49.542 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:49.848 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T11:44:49.958 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-09-10T11:44:50.114 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T11:44:50.131 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T11:44:50.232 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T11:44:50.399 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T11:44:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T11:44:50.650 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T11:44:50.768 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T11:44:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T11:44:51.011 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T11:44:51.197 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T11:44:51.254 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T11:44:51.276 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:51.380 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T11:44:51.767 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2024-09-10T11:44:51.798 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T11:44:51.882 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T11:44:52.142 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T11:44:52.175 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T11:44:52.427 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T11:44:52.435 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-10T11:44:52.553 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T11:44:52.677 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T11:44:52.821 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T11:44:52.937 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T11:44:53.080 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T11:44:53.181 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T11:44:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T11:44:53.483 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T11:44:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T11:44:53.835 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T11:44:53.866 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T11:44:54.111 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-10T11:44:54.158 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:54.363 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T11:44:54.410 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T11:44:54.519 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T11:44:54.622 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T11:44:54.628 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-10T11:44:54.874 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T11:44:54.887 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T11:44:55.014 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T11:44:55.117 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T11:44:55.273 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T11:44:55.377 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T11:44:55.702 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:44:55.760 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T11:44:55.788 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T11:44:55.852 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T11:44:55.970 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T11:44:55.977 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T11:44:56.080 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T11:44:56.181 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-10T11:44:56.354 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T11:44:56.415 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T11:44:56.480 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T11:44:56.516 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T11:44:56.747 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T11:44:56.759 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T11:44:57.007 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T11:44:57.151 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T11:44:57.183 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T11:44:57.238 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T11:44:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T11:44:57.339 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T11:44:57.434 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T11:44:57.682 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T11:44:57.783 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T11:44:58.043 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T11:44:58.069 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T11:44:58.302 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T11:44:58.329 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T11:44:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T11:44:58.581 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T11:44:58.611 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T11:44:58.738 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T11:44:58.900 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T11:44:59.283 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T11:44:59.373 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T11:44:59.526 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T11:44:59.616 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T11:44:59.750 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T11:44:59.877 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T11:44:59.902 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T11:45:00.169 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T11:45:00.212 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-10T11:45:00.505 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T11:45:00.571 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T11:45:00.805 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T11:45:00.856 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T11:45:01.132 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T11:45:01.174 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T11:45:01.242 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:01.450 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-10T11:45:01.526 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T11:45:01.769 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T11:45:01.844 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T11:45:02.111 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T11:45:02.396 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T11:45:02.497 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:02.790 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T11:45:02.992 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T11:45:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T11:45:03.244 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:45:03.353 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T11:45:03.612 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T11:45:03.738 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T11:45:03.864 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T11:45:04.157 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T11:45:04.224 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T11:45:04.417 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T11:45:04.458 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:45:04.569 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T11:45:04.672 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:45:04.825 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T11:45:04.833 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T11:45:04.953 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T11:45:05.078 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T11:45:05.104 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T11:45:05.347 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T11:45:05.363 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T11:45:05.606 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T11:45:05.614 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T11:45:05.860 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T11:45:05.860 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:45:05.969 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T11:45:06.116 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T11:45:06.384 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T11:45:06.478 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T11:45:06.502 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T11:45:06.746 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T11:45:06.787 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T11:45:06.971 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T11:45:07.006 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T11:45:07.257 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T11:45:07.263 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T11:45:07.499 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T11:45:07.565 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T11:45:07.759 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T11:45:07.816 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T11:45:07.893 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T11:45:07.942 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T11:45:08.068 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T11:45:08.141 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T11:45:08.177 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T11:45:08.303 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T11:45:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T11:45:08.487 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T11:45:08.588 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T11:45:08.872 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T11:45:08.889 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T11:45:09.123 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T11:45:09.157 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T11:45:09.249 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T11:45:09.283 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T11:45:09.409 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T11:45:09.499 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T11:45:09.508 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:45:09.643 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T11:45:09.752 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T11:45:09.878 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T11:45:09.952 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T11:45:10.228 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T11:45:10.288 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T11:45:10.505 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T11:45:10.539 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T11:45:10.648 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T11:45:10.716 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T11:45:10.891 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T11:45:10.984 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T11:45:10.992 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T11:45:11.269 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T11:45:11.309 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T11:45:11.512 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T11:45:11.604 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T11:45:11.879 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T11:45:11.889 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T11:45:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T11:45:12.341 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T11:45:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T11:45:12.634 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T11:45:12.676 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T11:45:12.787 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:12.902 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T11:45:12.913 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:13.039 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T11:45:13.287 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T11:45:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:13.563 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T11:45:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T11:45:13.888 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:13.899 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T11:45:14.014 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.025 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.140 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.151 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.277 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T11:45:14.350 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T11:45:14.350 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T11:45:14.621 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.722 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.823 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T11:45:14.849 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:14.976 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:15.077 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:15.099 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:15.194 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-top (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:15.209 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:15.329 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T11:45:15.335 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:15.563 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T11:45:15.563 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T11:45:16.045 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.171 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.330 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.465 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.482 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.565 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T11:45:16.608 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.735 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.835 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:16.953 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-shell (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:17.063 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:17.605 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-09-10T11:45:17.781 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:17.890 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:17.923 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-09-10T11:45:17.991 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:18.093 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-09-10T11:45:18.123 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T11:45:18.218 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:18.260 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T11:45:18.344 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:18.605 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T11:45:18.903 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2024-09-10T11:45:19.064 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-mirror (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:19.247 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2024-09-10T11:45:19.273 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:45:19.273 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:45:19.391 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2024-09-10T11:45:19.404 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T11:45:19.540 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T11:45:19.757 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:19.870 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T11:45:19.883 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:20.345 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:45:20.345 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:45:20.354 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:20.590 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:45:20.590 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:45:20.793 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:21.129 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T11:45:21.239 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:21.365 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:21.587 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:21.816 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T11:45:21.816 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T11:45:21.849 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:45:21.852 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:45:22.314 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:22.346 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:22.526 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T11:45:22.526 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T11:45:22.693 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T11:45:23.007 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:23.156 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:23.289 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T11:45:23.289 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T11:45:23.385 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T11:45:23.385 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T11:45:23.800 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:23.858 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:23.926 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:24.065 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T11:45:24.065 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T11:45:24.094 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:24.316 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T11:45:24.317 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T11:45:24.526 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:24.762 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:24.831 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T11:45:24.831 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T11:45:24.888 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:25.014 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:25.165 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:25.336 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:25.487 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:25.526 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T11:45:25.618 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T11:45:25.655 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:25.780 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T11:45:25.865 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T11:45:25.865 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T11:45:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:26.499 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:26.625 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:26.768 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-10T11:45:26.914 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T11:45:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T11:45:27.570 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T11:45:27.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-10T11:45:27.625 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T11:45:27.675 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T11:45:27.777 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T11:45:27.885 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T11:45:27.886 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T11:45:28.084 INFO:teuthology.orchestra.run.smithi112.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-10T11:45:28.084 INFO:teuthology.orchestra.run.smithi112.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-10T11:45:28.084 INFO:teuthology.orchestra.run.smithi112.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-10T11:45:28.084 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:45:28.084 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:45:28.085 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:45:28.085 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:45:28.085 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T11:45:28.085 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T11:45:28.085 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:45:28.086 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-10T11:45:28.086 INFO:teuthology.orchestra.run.smithi112.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-10T11:45:28.086 INFO:teuthology.orchestra.run.smithi112.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-10T11:45:28.087 INFO:teuthology.orchestra.run.smithi112.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-10T11:45:28.087 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-10T11:45:28.087 INFO:teuthology.orchestra.run.smithi112.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T11:45:28.088 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-10T11:45:28.088 INFO:teuthology.orchestra.run.smithi112.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-10T11:45:28.088 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-10T11:45:28.088 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-10T11:45:28.130 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-10T11:45:28.131 INFO:teuthology.orchestra.run.smithi112.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-10T11:45:28.131 INFO:teuthology.orchestra.run.smithi112.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-10T11:45:28.132 INFO:teuthology.orchestra.run.smithi112.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-10T11:45:28.132 INFO:teuthology.orchestra.run.smithi112.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-10T11:45:28.132 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-10T11:45:28.132 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-10T11:45:28.132 INFO:teuthology.orchestra.run.smithi112.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T11:45:28.133 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-10T11:45:28.134 INFO:teuthology.orchestra.run.smithi112.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-10T11:45:28.186 INFO:teuthology.orchestra.run.smithi112.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-10T11:45:28.186 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 55.8 MB of archives. 2024-09-10T11:45:28.186 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-10T11:45:28.186 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-10T11:45:28.339 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-10T11:45:28.346 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-10T11:45:28.385 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-10T11:45:28.385 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-10T11:45:28.386 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-10T11:45:28.397 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-10T11:45:28.398 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-10T11:45:28.400 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-10T11:45:28.402 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-10T11:45:28.402 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-10T11:45:28.404 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-10T11:45:28.405 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-10T11:45:28.421 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-10T11:45:28.421 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-10T11:45:28.422 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-10T11:45:28.493 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T11:45:28.685 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-10T11:45:28.741 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-10T11:45:28.741 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-10T11:45:28.743 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-10T11:45:28.744 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-10T11:45:28.748 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-10T11:45:28.749 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-10T11:45:28.756 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-10T11:45:28.757 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-10T11:45:28.778 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-10T11:45:28.778 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-10T11:45:28.787 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-10T11:45:28.806 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-10T11:45:28.809 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-10T11:45:28.809 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-10T11:45:28.810 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-10T11:45:28.810 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-10T11:45:28.820 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-10T11:45:28.821 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-10T11:45:29.023 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-10T11:45:29.023 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-10T11:45:29.023 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-10T11:45:29.024 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-10T11:45:29.024 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-10T11:45:29.024 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-10T11:45:29.035 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-10T11:45:29.035 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-10T11:45:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T11:45:29.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-10T11:45:29.217 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-10T11:45:29.411 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-10T11:45:29.411 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-10T11:45:29.447 INFO:teuthology.orchestra.run.smithi112.stdout:Preconfiguring packages ... 2024-09-10T11:45:29.591 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 55.8 MB in 1s (62.3 MB/s) 2024-09-10T11:45:29.592 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-10T11:45:29.592 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-10T11:45:29.592 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-10T11:45:29.592 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T11:45:29.592 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T11:45:29.593 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T11:45:29.593 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T11:45:29.593 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T11:45:29.593 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T11:45:29.593 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T11:45:29.594 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-10T11:45:29.594 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-10T11:45:29.594 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-10T11:45:29.595 INFO:teuthology.orchestra.run.smithi078.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-10T11:45:29.595 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-10T11:45:29.595 INFO:teuthology.orchestra.run.smithi078.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T11:45:29.596 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-10T11:45:29.596 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-10T11:45:29.596 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-10T11:45:29.596 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-10T11:45:29.635 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-10T11:45:29.636 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-10T11:45:29.636 INFO:teuthology.orchestra.run.smithi078.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-10T11:45:29.637 INFO:teuthology.orchestra.run.smithi078.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-10T11:45:29.637 INFO:teuthology.orchestra.run.smithi078.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-10T11:45:29.637 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-10T11:45:29.637 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-10T11:45:29.637 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T11:45:29.638 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-09-10T11:45:29.639 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-10T11:45:29.818 INFO:teuthology.orchestra.run.smithi078.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-10T11:45:29.818 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 55.8 MB of archives. 2024-09-10T11:45:29.818 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-10T11:45:29.819 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-10T11:45:29.893 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176342 files and directories currently installed.) 2024-09-10T11:45:29.898 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T11:45:30.145 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T11:45:30.441 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-10T11:45:30.457 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-10T11:45:30.581 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-10T11:45:30.582 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-10T11:45:30.584 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-10T11:45:30.612 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-10T11:45:30.614 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-10T11:45:30.617 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-10T11:45:30.620 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-10T11:45:30.621 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-10T11:45:30.624 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-10T11:45:30.686 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-10T11:45:30.686 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-10T11:45:30.687 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-10T11:45:30.732 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-10T11:45:30.767 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-10T11:45:31.543 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-10T11:45:31.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-10T11:45:31.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-10T11:45:31.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-10T11:45:31.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-10T11:45:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-10T11:45:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-10T11:45:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-10T11:45:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-10T11:45:31.660 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-10T11:45:31.672 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-10T11:45:31.688 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-10T11:45:31.705 INFO:teuthology.orchestra.run.smithi112.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-10T11:45:31.762 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-10T11:45:31.769 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-10T11:45:31.770 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-10T11:45:31.771 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-10T11:45:31.772 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-10T11:45:31.805 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-10T11:45:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-10T11:45:31.967 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package flex. 2024-09-10T11:45:32.061 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176342 files and directories currently installed.) 2024-09-10T11:45:32.067 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-10T11:45:32.107 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-10T11:45:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-10T11:45:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-10T11:45:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-10T11:45:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-10T11:45:32.354 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-10T11:45:32.354 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-10T11:45:32.379 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-10T11:45:32.380 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-10T11:45:32.641 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T11:45:32.795 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2024-09-10T11:45:32.935 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 55.8 MB in 3s (20.4 MB/s) 2024-09-10T11:45:33.033 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-10T11:45:33.256 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176342 files and directories currently installed.) 2024-09-10T11:45:33.262 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T11:45:33.407 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T11:45:33.443 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T11:45:33.957 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176415 files and directories currently installed.) 2024-09-10T11:45:33.961 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T11:45:34.073 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T11:45:34.095 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-10T11:45:34.491 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T11:45:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T11:45:34.950 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T11:45:35.061 INFO:teuthology.orchestra.run.smithi078.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-10T11:45:35.298 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package bison. 2024-09-10T11:45:35.390 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2024-09-10T11:45:35.400 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176415 files and directories currently installed.) 2024-09-10T11:45:35.406 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-10T11:45:35.441 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176342 files and directories currently installed.) 2024-09-10T11:45:35.447 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-10T11:45:35.468 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T11:45:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-10T11:45:35.860 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-10T11:45:35.887 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-10T11:45:35.926 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T11:45:36.126 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T11:45:36.254 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package dump. 2024-09-10T11:45:36.282 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-10T11:45:36.320 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking dump (0.4b47-3) ... 2024-09-10T11:45:36.332 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-10T11:45:36.599 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package indent. 2024-09-10T11:45:36.616 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:36.649 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T11:45:36.810 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T11:45:36.885 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-10T11:45:36.913 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-10T11:45:36.952 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T11:45:37.281 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-10T11:45:37.309 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-10T11:45:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176415 files and directories currently installed.) 2024-09-10T11:45:37.318 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T11:45:37.348 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T11:45:37.441 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T11:45:37.608 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-10T11:45:37.625 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-10T11:45:37.667 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T11:45:37.941 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T11:45:37.970 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-10T11:45:37.998 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-10T11:45:38.037 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T11:45:38.113 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T11:45:38.323 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-10T11:45:38.339 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-10T11:45:38.382 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T11:45:38.456 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T11:45:38.634 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjson-perl. 2024-09-10T11:45:38.650 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-10T11:45:38.693 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-10T11:45:38.830 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2024-09-10T11:45:38.936 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176415 files and directories currently installed.) 2024-09-10T11:45:38.942 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-10T11:45:38.962 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-10T11:45:38.979 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-10T11:45:38.999 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T11:45:39.012 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T11:45:39.391 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-10T11:45:39.419 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-10T11:45:39.449 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T11:45:39.785 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2024-09-10T11:45:39.813 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-10T11:45:39.852 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b47-3) ... 2024-09-10T11:45:40.139 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2024-09-10T11:45:40.155 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:40.197 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T11:45:40.458 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-10T11:45:40.474 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-10T11:45:40.508 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T11:45:40.649 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-10T11:45:40.677 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T11:45:40.715 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:45:40.770 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-10T11:45:40.798 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-10T11:45:40.837 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T11:45:40.976 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-10T11:45:40.993 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T11:45:41.034 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:45:41.089 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-10T11:45:41.106 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-10T11:45:41.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T11:45:41.337 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-10T11:45:41.365 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T11:45:41.462 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:45:41.476 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-10T11:45:41.504 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-10T11:45:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T11:45:41.762 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-10T11:45:41.778 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-10T11:45:41.811 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T11:45:41.840 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-10T11:45:41.869 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-10T11:45:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T11:45:42.056 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjson-perl. 2024-09-10T11:45:42.072 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-10T11:45:42.114 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-10T11:45:42.235 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-10T11:45:42.263 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T11:45:42.301 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T11:45:42.417 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-10T11:45:42.446 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-10T11:45:42.484 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T11:45:42.596 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-10T11:45:42.624 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:42.663 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:42.982 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-10T11:45:43.011 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:43.049 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:45:43.837 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-10T11:45:43.865 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:43.903 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:45:44.181 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-10T11:45:44.186 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-10T11:45:44.197 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T11:45:44.203 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T11:45:44.231 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T11:45:44.236 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:45:44.472 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-10T11:45:44.489 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T11:45:44.522 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:45:44.735 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-10T11:45:44.763 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-10T11:45:44.801 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T11:45:44.858 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-10T11:45:44.887 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T11:45:44.925 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:45:45.154 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package modemmanager. 2024-09-10T11:45:45.182 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T11:45:45.221 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:45:45.295 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-10T11:45:45.323 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-10T11:45:45.361 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T11:45:45.639 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-10T11:45:45.668 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T11:45:45.697 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T11:45:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager. 2024-09-10T11:45:45.881 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T11:45:45.928 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-10T11:45:46.017 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-10T11:45:46.045 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:46.083 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:46.428 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-10T11:45:46.457 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:46.460 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ppp. 2024-09-10T11:45:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-10T11:45:46.494 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:45:46.724 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T11:45:46.793 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-10T11:45:46.822 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:46.855 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:45:47.057 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pptp-linux. 2024-09-10T11:45:47.057 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-10T11:45:47.074 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T11:45:47.085 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-10T11:45:47.116 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T11:45:47.123 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-10T11:45:47.376 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-10T11:45:47.392 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-10T11:45:47.434 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-10T11:45:47.678 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-10T11:45:47.707 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-10T11:45:47.737 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-10T11:45:47.744 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T11:45:47.765 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-10T11:45:47.804 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-common (238) ... 2024-09-10T11:45:48.091 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-10T11:45:48.119 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:48.148 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2024-09-10T11:45:48.158 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:48.176 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T11:45:48.222 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:45:48.738 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-common. 2024-09-10T11:45:48.766 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-10T11:45:48.823 INFO:teuthology.orchestra.run.smithi112.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-10T11:45:48.970 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-common (238) ... 2024-09-10T11:45:48.970 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2024-09-10T11:45:48.999 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T11:45:49.054 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-10T11:45:49.413 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-14. 2024-09-10T11:45:49.442 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:49.483 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:49.836 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2024-09-10T11:45:49.864 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-10T11:45:50.162 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T11:45:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2024-09-10T11:45:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-10T11:45:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-10T11:45:50.825 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql. 2024-09-10T11:45:50.837 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-10T11:45:50.842 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-10T11:45:50.865 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-10T11:45:50.899 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql (14+238) ... 2024-09-10T11:45:50.912 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-10T11:45:51.143 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client. 2024-09-10T11:45:51.160 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-10T11:45:51.202 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client (14+238) ... 2024-09-10T11:45:51.282 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-10T11:45:51.310 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-10T11:45:51.357 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (238) ... 2024-09-10T11:45:51.454 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-10T11:45:51.470 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-10T11:45:51.512 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-10T11:45:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-10T11:45:51.680 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:51.719 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:51.840 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package tcl8.6. 2024-09-10T11:45:51.869 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-10T11:45:51.906 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T11:45:52.134 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package tcl. 2024-09-10T11:45:52.150 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-10T11:45:52.189 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-10T11:45:52.432 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2024-09-10T11:45:52.460 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-10T11:45:52.526 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-10T11:45:52.537 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package wpasupplicant. 2024-09-10T11:45:52.554 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (238) ... 2024-09-10T11:45:52.565 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-10T11:45:52.603 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T11:45:53.016 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-10T11:45:53.033 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-10T11:45:53.075 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-10T11:45:53.394 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-10T11:45:53.424 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-10T11:45:53.461 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T11:45:53.744 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-common (238) ... 2024-09-10T11:45:53.806 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-14. 2024-09-10T11:45:53.834 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T11:45:53.875 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:53.961 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-10T11:45:54.087 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T11:45:54.204 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:54.314 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T11:45:54.431 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T11:45:54.557 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:55.057 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-10T11:45:55.146 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T11:45:55.185 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2024-09-10T11:45:55.202 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-10T11:45:55.243 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (14+238) ... 2024-09-10T11:45:55.495 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2024-09-10T11:45:55.524 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-10T11:45:55.525 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T11:45:55.525 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T11:45:55.561 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (14+238) ... 2024-09-10T11:45:55.847 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-10T11:45:55.876 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-10T11:45:55.922 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-10T11:45:56.007 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T11:45:56.142 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T11:45:56.268 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T11:45:56.325 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl8.6. 2024-09-10T11:45:56.354 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-10T11:45:56.385 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-10T11:45:56.399 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T11:45:56.503 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T11:45:56.612 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T11:45:56.702 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl. 2024-09-10T11:45:56.731 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-10T11:45:56.738 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T11:45:56.774 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-10T11:45:56.864 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T11:45:57.122 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2024-09-10T11:45:57.151 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-10T11:45:57.197 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T11:45:57.469 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T11:45:57.595 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up dump (0.4b47-3) ... 2024-09-10T11:45:57.618 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-10T11:45:57.634 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-10T11:45:57.684 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-10T11:45:57.689 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-10T11:45:57.755 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:45:58.006 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T11:45:58.096 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-10T11:45:58.125 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-10T11:45:58.140 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-10T11:45:58.171 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T11:45:58.266 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-10T11:45:58.401 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T11:45:58.482 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-10T11:45:58.509 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (238) ... 2024-09-10T11:45:58.563 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T11:45:58.678 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T11:45:58.711 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-10T11:45:58.837 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T11:45:58.854 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T11:45:58.963 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:58.980 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:45:59.089 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T11:45:59.215 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T11:45:59.324 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:45:59.473 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-10T11:45:59.641 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client (14+238) ... 2024-09-10T11:45:59.775 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-10T11:45:59.853 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-10T11:45:59.946 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T11:46:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:00.237 INFO:teuthology.orchestra.run.smithi112.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-10T11:46:00.237 INFO:teuthology.orchestra.run.smithi112.stdout:which means they are currently configured by ifupdown: 2024-09-10T11:46:00.237 INFO:teuthology.orchestra.run.smithi112.stdout:- enp3s0f1 2024-09-10T11:46:00.237 INFO:teuthology.orchestra.run.smithi112.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-10T11:46:00.237 INFO:teuthology.orchestra.run.smithi112.stdout:remove their configuration from /etc/network/interfaces. 2024-09-10T11:46:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:00.329 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T11:46:00.329 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T11:46:00.353 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-10T11:46:00.672 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-10T11:46:00.800 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T11:46:00.926 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T11:46:00.980 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-10T11:46:01.052 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T11:46:01.178 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-10T11:46:01.304 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T11:46:01.428 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:46:01.429 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T11:46:01.546 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T11:46:01.547 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T11:46:01.655 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-10T11:46:01.657 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T11:46:01.781 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-common (238) ... 2024-09-10T11:46:02.329 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T11:46:02.530 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b47-3) ... 2024-09-10T11:46:02.607 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-10T11:46:02.665 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:46:02.712 INFO:teuthology.orchestra.run.smithi112.stdout:Adding user postgres to group ssl-cert 2024-09-10T11:46:02.791 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T11:46:02.917 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-10T11:46:02.918 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:02.919 INFO:teuthology.orchestra.run.smithi112.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-10T11:46:03.043 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-10T11:46:03.165 INFO:teuthology.orchestra.run.smithi112.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-10T11:46:03.165 INFO:teuthology.orchestra.run.smithi112.stdout:Removing obsolete dictionary files: 2024-09-10T11:46:03.169 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T11:46:03.260 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-10T11:46:03.329 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T11:46:03.745 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-10T11:46:03.857 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T11:46:04.016 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T11:46:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:46:04.142 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:46:04.268 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-10T11:46:04.403 INFO:teuthology.orchestra.run.smithi112.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-10T11:46:04.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-10T11:46:04.435 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (14+238) ... 2024-09-10T11:46:04.458 INFO:teuthology.orchestra.run.smithi112.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-10T11:46:04.458 INFO:teuthology.orchestra.run.smithi112.stdout:This user must also own the server process. 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout:The database cluster will be initialized with locale "en_US". 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout:The default text search configuration will be set to "english". 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout:Data page checksums are disabled. 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-10T11:46:04.459 INFO:teuthology.orchestra.run.smithi112.stdout:creating subdirectories ... ok 2024-09-10T11:46:04.460 INFO:teuthology.orchestra.run.smithi112.stdout:selecting dynamic shared memory implementation ... posix 2024-09-10T11:46:04.474 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default max_connections ... 100 2024-09-10T11:46:04.495 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default shared_buffers ... 128MB 2024-09-10T11:46:04.504 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default time zone ... Etc/UTC 2024-09-10T11:46:04.505 INFO:teuthology.orchestra.run.smithi112.stdout:creating configuration files ... ok 2024-09-10T11:46:04.562 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-10T11:46:04.620 INFO:teuthology.orchestra.run.smithi112.stdout:running bootstrap script ... ok 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2024-09-10T11:46:05.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:05.127 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-10T11:46:05.316 INFO:teuthology.orchestra.run.smithi112.stdout:performing post-bootstrap initialization ... ok 2024-09-10T11:46:05.448 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-10T11:46:05.800 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-10T11:46:06.145 INFO:teuthology.orchestra.run.smithi112.stdout:syncing data to disk ... ok 2024-09-10T11:46:06.290 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T11:46:06.417 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T11:46:06.553 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-10T11:46:06.653 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-10T11:46:06.654 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (238) ... 2024-09-10T11:46:07.586 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2024-09-10T11:46:07.788 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:07.788 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-10T11:46:07.978 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-10T11:46:07.978 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2024-09-10T11:46:08.487 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-10T11:46:08.862 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T11:46:09.189 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-10T11:46:09.219 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-10T11:46:09.266 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2024-09-10T11:46:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2024-09-10T11:46:09.282 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2024-09-10T11:46:09.289 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:46:09.303 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2024-09-10T11:46:09.313 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2024-09-10T11:46:09.314 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2024-09-10T11:46:09.415 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-10T11:46:09.428 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2024-09-10T11:46:09.541 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql (14+238) ... 2024-09-10T11:46:09.667 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:46:09.793 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:46:10.048 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T11:46:10.048 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T11:46:10.088 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2024-09-10T11:46:10.562 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T11:46:10.646 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-10T11:46:10.948 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T11:46:11.017 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2024-09-10T11:46:11.100 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T11:46:11.417 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-10T11:46:12.428 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-10T11:46:12.528 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T11:46:13.021 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T11:46:13.027 DEBUG:teuthology.parallel:result is None 2024-09-10T11:46:14.279 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:46:14.397 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-10T11:46:14.498 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (14+238) ... 2024-09-10T11:46:14.615 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T11:46:14.741 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T11:46:14.998 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T11:46:14.998 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T11:46:15.578 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T11:46:15.670 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-10T11:46:15.964 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T11:46:16.124 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T11:46:17.536 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-10T11:46:17.635 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T11:46:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T11:46:18.155 DEBUG:teuthology.parallel:result is None 2024-09-10T11:46:18.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:46:18.304 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2024-09-10T11:46:18.323 INFO:teuthology.orchestra.run.smithi078.stdout:19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:46:18.323 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:46:18.323 INFO:teuthology.task.install:The correct ceph version 19.3.0-4704-g8b38c33c-1jammy is installed. 2024-09-10T11:46:18.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:46:18.465 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-09-10T11:46:18.485 INFO:teuthology.orchestra.run.smithi112.stdout:19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:46:18.485 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4704-g8b38c33c-1jammy 2024-09-10T11:46:18.485 INFO:teuthology.task.install:The correct ceph version 19.3.0-4704-g8b38c33c-1jammy is installed. 2024-09-10T11:46:18.487 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T11:46:18.487 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:18.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:46:18.501 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:18.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:46:18.538 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T11:46:18.539 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:18.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:46:18.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:46:18.610 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:18.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:46:18.624 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:46:18.677 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T11:46:18.678 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:18.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:46:18.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:46:18.745 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:18.746 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:46:18.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:46:18.813 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T11:46:18.814 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:18.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:46:18.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:46:18.882 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:18.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:46:18.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:46:18.950 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T11:46:19.037 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T11:46:19.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-09-10T11:46:19.040 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-10T11:46:19.053 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T11:46:19.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T11:46:19.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T11:46:19.112 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T11:46:19.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T11:46:19.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T11:46:19.174 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T11:46:19.174 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T11:46:19.174 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T11:46:19.174 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:19.174 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T11:46:19.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T11:46:19.290 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:19.290 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T11:46:19.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T11:46:19.375 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T11:46:19.376 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T11:46:19.376 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102', 'branch': 'wip-athakkar-testing-2024-09-04-1837', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/snapshot}}', 'email': None, 'first_in_suite': False, 'job_id': '7899102', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-04-1837'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-04-1837', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}}, 'owner': 'scheduled_khiremat@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9123, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-04-1837', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMtYj9+ELleOaZhZ8o3eJqkbUG+rYWQuqiE5jQlwIzBc20mW+BwzPtrUfIPrOZO6Hqo5PnbZzpgc+TAFr/zS+m4=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuhE1wMnCMxFARkBr6Iu/gWdNMtVaMKRel2c3vNNwI4ItN57eUDBWNhkCicMNJzmIgamd6q6FYYmAWIQPQMzIg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_07:26:29', 'tube': 'smithi', 'user': 'khiremat', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T11:46:19.376 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T11:46:19.379 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T11:46:19.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T11:46:19.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T11:46:19.474 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:19.474 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:46:19.491 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:46:19.491 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-10T11:46:19.539 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:46:19.539 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:19.539 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-09-10T11:46:19.539 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:19.539 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-10 11:39:59.937505763 +0000 2024-09-10T11:46:19.540 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-10 11:39:59.693507942 +0000 2024-09-10T11:46:19.540 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-10 11:39:59.693507942 +0000 2024-09-10T11:46:19.540 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-10T11:46:19.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:46:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-10T11:46:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-10T11:46:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000452075 s, 1.1 MB/s 2024-09-10T11:46:19.596 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:46:19.645 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-10 11:40:00.413501511 +0000 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-10 11:40:00.169503691 +0000 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-10 11:40:00.169503691 +0000 2024-09-10T11:46:19.691 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-10T11:46:19.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-10T11:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-10T11:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000419645 s, 1.2 MB/s 2024-09-10T11:46:19.747 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:46:19.796 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-10T11:46:19.843 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:46:19.843 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:19.843 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-10T11:46:19.844 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:19.844 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-10 11:40:00.893497224 +0000 2024-09-10T11:46:19.844 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-10 11:40:00.657499332 +0000 2024-09-10T11:46:19.844 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-10 11:40:00.657499332 +0000 2024-09-10T11:46:19.844 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-10T11:46:19.844 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:46:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-10T11:46:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-10T11:46:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000382684 s, 1.3 MB/s 2024-09-10T11:46:19.898 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:46:19.948 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-10 11:40:01.405492650 +0000 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-10 11:40:01.125495152 +0000 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-10 11:40:01.125495152 +0000 2024-09-10T11:46:19.995 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-10T11:46:19.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:46:20.049 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-10T11:46:20.049 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-10T11:46:20.049 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000397221 s, 1.3 MB/s 2024-09-10T11:46:20.051 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:46:20.101 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:20.101 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:20.101 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:46:20.107 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:46:20.107 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 11:39:59.881013058 +0000 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 11:39:59.609015490 +0000 2024-09-10T11:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 11:39:59.609015490 +0000 2024-09-10T11:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T11:46:20.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:46:20.209 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T11:46:20.210 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T11:46:20.210 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000454873 s, 1.1 MB/s 2024-09-10T11:46:20.211 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:46:20.260 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 11:40:00.409008341 +0000 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 11:40:00.125010879 +0000 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 11:40:00.125010879 +0000 2024-09-10T11:46:20.307 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T11:46:20.307 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:46:20.361 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T11:46:20.361 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T11:46:20.361 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000315355 s, 1.6 MB/s 2024-09-10T11:46:20.362 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:46:20.412 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-10T11:46:20.458 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:46:20.458 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:20.459 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-10T11:46:20.459 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:20.459 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 11:40:00.637006304 +0000 2024-09-10T11:46:20.459 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 11:40:00.633006340 +0000 2024-09-10T11:46:20.459 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 11:40:00.633006340 +0000 2024-09-10T11:46:20.459 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T11:46:20.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:46:20.513 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T11:46:20.513 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T11:46:20.513 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00043621 s, 1.2 MB/s 2024-09-10T11:46:20.515 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:46:20.564 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-10T11:46:20.610 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:46:20.610 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:46:20.611 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-10T11:46:20.611 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:46:20.611 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 11:40:01.372999733 +0000 2024-09-10T11:46:20.611 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 11:40:01.125001947 +0000 2024-09-10T11:46:20.611 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 11:40:01.125001947 +0000 2024-09-10T11:46:20.611 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T11:46:20.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:46:20.665 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T11:46:20.665 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T11:46:20.665 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000386654 s, 1.3 MB/s 2024-09-10T11:46:20.666 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:46:20.716 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:20.716 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T11:46:20.716 INFO:tasks.ceph:Generating config... 2024-09-10T11:46:20.718 INFO:tasks.ceph:[client] pid file = 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T11:46:20.718 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T11:46:20.719 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T11:46:20.719 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T11:46:20.720 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T11:46:20.720 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T11:46:20.720 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T11:46:20.720 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T11:46:20.720 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T11:46:20.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T11:46:20.754 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T11:46:20.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T11:46:20.844 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T11:46:20.899 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]')] 2024-09-10T11:46:20.899 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T11:46:20.900 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:20.900 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T11:46:20.947 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:21.033 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:21.034 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid 785b090d-5d49-42c2-82da-a514da1d8c8c 2024-09-10T11:46:21.034 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-10T11:46:21.034 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 785b090d-5d49-42c2-82da-a514da1d8c8c 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-09-10T11:46:21.034401+0000 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-10T11:46:21.034401+0000 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2024-09-10T11:46:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T11:46:21.036 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T11:46:21.083 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 785b090d-5d49-42c2-82da-a514da1d8c8c... 2024-09-10T11:46:21.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T11:46:21.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T11:46:21.156 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-10T11:46:21.156 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-09-10T11:46:21.156 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T11:46:21.156 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-09-10T11:46:21.156 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T11:46:21.157 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-09-10T11:46:21.158 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-09-10T11:46:21.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 785b090d-5d49-42c2-82da-a514da1d8c8c 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-09-10T11:46:21.160 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-09-10T11:46:21.162 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-10T11:46:21.163 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 30 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: debug finisher = 20 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-10T11:46:21.164 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T11:46:21.165 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: mon down mkfs grace = 300 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-09-10T11:46:21.166 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = "" 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-09-10T11:46:21.167 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-10T11:46:21.168 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.169 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.78,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 785b090d-5d49-42c2-82da-a514da1d8c8c 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-10T11:46:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-10T11:46:21.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.173 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-10T11:46:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:46:21.175 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 30 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: debug finisher = 20 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-10T11:46:21.176 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T11:46:21.177 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T11:46:21.178 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-10T11:46:21.179 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-10T11:46:21.180 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T11:46:21.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T11:46:21.273 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T11:46:21.273 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:21.273 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T11:46:21.278 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:21.278 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T11:46:21.327 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:46:21.327 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:21.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T11:46:21.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T11:46:21.392 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:21.392 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:21.439 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:46:21.439 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:21.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T11:46:21.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T11:46:21.462 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:21.463 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:21.510 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T11:46:21.511 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T11:46:21.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T11:46:21.555 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T11:46:21.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T11:46:21.603 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T11:46:21.644 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T11:46:21.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T11:46:21.689 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T11:46:21.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T11:46:21.746 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T11:46:21.827 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T11:46:21.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T11:46:21.886 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T11:46:21.931 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T11:46:21.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T11:46:21.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T11:46:22.030 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T11:46:22.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T11:46:22.089 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T11:46:22.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T11:46:22.125 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T11:46:22.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T11:46:22.210 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T11:46:22.220 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T11:46:22.255 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T11:46:22.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T11:46:22.341 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T11:46:22.350 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T11:46:22.351 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T11:46:22.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T11:46:22.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:22.363 INFO:tasks.ceph:role: osd.0 2024-09-10T11:46:22.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:46:22.363 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T11:46:22.426 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:22.426 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:22.426 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:22.426 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:22.427 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:22.427 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:22.427 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:22.427 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:22.427 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:22.427 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:22.887 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-10T11:46:22.888 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-10T11:46:22.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T11:46:22.989 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T11:46:23.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:23.001 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:23.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T11:46:23.058 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:23.058 INFO:tasks.ceph:role: osd.1 2024-09-10T11:46:23.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:46:23.058 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T11:46:23.122 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:23.122 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:23.122 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:23.122 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:23.122 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:23.122 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:23.123 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:23.123 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:23.123 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:23.123 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:23.584 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-10T11:46:23.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-10T11:46:23.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T11:46:23.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T11:46:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:23.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:23.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T11:46:23.786 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:23.786 INFO:tasks.ceph:role: osd.2 2024-09-10T11:46:23.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:46:23.787 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T11:46:23.850 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:23.850 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:23.851 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:24.330 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-10T11:46:24.332 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-10T11:46:24.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T11:46:24.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T11:46:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:24.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:24.484 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T11:46:24.539 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:24.539 INFO:tasks.ceph:role: osd.3 2024-09-10T11:46:24.539 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:46:24.539 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T11:46:24.604 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:24.604 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:24.604 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:24.604 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:24.604 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:24.604 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:24.605 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:24.605 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:24.605 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:24.605 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:25.049 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-10T11:46:25.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-10T11:46:25.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T11:46:25.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T11:46:25.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:25.183 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:25.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:25.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:25.291+0000 7ffb380ff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T11:46:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:25.291+0000 7ffb380ff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T11:46:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:25.291+0000 7ffb380ff7c0 -1 bdev(0x55b31c3bf800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:25.291+0000 7ffb380ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T11:46:28.438 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T11:46:28.452 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:28.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:28.527+0000 7f2a1555c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T11:46:28.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:28.527+0000 7f2a1555c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T11:46:28.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:28.527+0000 7f2a1555c7c0 -1 bdev(0x559735e5b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:28.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:28.527+0000 7f2a1555c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T11:46:31.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T11:46:31.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:31.791+0000 7f538714f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T11:46:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:31.791+0000 7f538714f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T11:46:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:31.791+0000 7f538714f7c0 -1 bdev(0x55c4db85d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:31.795+0000 7f538714f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T11:46:34.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T11:46:34.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:35.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:35.075+0000 7f2423a577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T11:46:35.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:35.075+0000 7f2423a577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T11:46:35.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:35.075+0000 7f2423a577c0 -1 bdev(0x5602a2e9d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:35.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:46:35.075+0000 7f2423a577c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T11:46:38.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T11:46:38.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T11:46:38.292 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:38.292 INFO:tasks.ceph:role: osd.4 2024-09-10T11:46:38.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:46:38.292 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T11:46:38.354 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:38.354 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:38.354 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:38.354 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:38.354 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:38.354 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:38.355 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:38.355 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:38.355 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:38.355 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:38.805 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T11:46:38.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T11:46:38.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T11:46:38.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T11:46:38.922 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:38.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:38.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T11:46:38.980 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:38.980 INFO:tasks.ceph:role: osd.5 2024-09-10T11:46:38.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:46:38.981 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T11:46:39.041 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:39.041 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:39.041 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:39.041 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:39.042 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:39.042 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:39.042 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:39.042 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:39.042 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:39.042 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:39.508 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T11:46:39.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T11:46:39.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T11:46:39.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T11:46:39.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:39.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T11:46:39.717 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:39.717 INFO:tasks.ceph:role: osd.6 2024-09-10T11:46:39.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:46:39.718 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T11:46:39.780 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:39.781 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:40.278 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T11:46:40.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T11:46:40.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T11:46:40.418 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T11:46:40.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:40.430 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T11:46:40.486 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:46:40.486 INFO:tasks.ceph:role: osd.7 2024-09-10T11:46:40.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:46:40.486 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T11:46:40.549 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:46:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:46:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:46:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T11:46:40.549 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:46:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:46:40.550 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:46:40.550 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T11:46:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:46:40.550 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:46:40.979 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T11:46:40.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T11:46:40.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T11:46:41.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T11:46:41.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:46:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T11:46:41.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:41.204+0000 7f1e009097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T11:46:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:41.204+0000 7f1e009097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T11:46:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:41.204+0000 7f1e009097c0 -1 bdev(0x563827ca7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:41.204+0000 7f1e009097c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T11:46:44.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T11:46:44.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:44.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:44.424+0000 7fa34e9967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T11:46:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:44.424+0000 7fa34e9967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T11:46:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:44.424+0000 7fa34e9967c0 -1 bdev(0x5626fe429800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:44.424+0000 7fa34e9967c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T11:46:47.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T11:46:47.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:47.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:47.724+0000 7f11fafe47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T11:46:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:47.724+0000 7f11fafe47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T11:46:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:47.724+0000 7f11fafe47c0 -1 bdev(0x562d2a27b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:47.724+0000 7f11fafe47c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T11:46:49.377 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:46:49.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:46:50.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T11:46:50.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:50.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:50.944+0000 7f8597f7d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T11:46:50.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:50.944+0000 7f8597f7d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T11:46:50.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:50.944+0000 7f8597f7d7c0 -1 bdev(0x55f2349bd800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T11:46:50.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:46:50.944+0000 7f8597f7d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T11:46:54.084 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T11:46:54.138 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T11:46:54.138 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T11:46:54.152 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T11:46:54.206 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.206 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T11:46:54.262 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T11:46:54.318 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T11:46:54.374 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.374 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T11:46:54.429 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T11:46:54.485 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T11:46:54.499 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T11:46:54.553 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.553 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T11:46:54.608 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T11:46:54.660 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T11:46:54.713 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T11:46:54.768 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.768 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T11:46:54.820 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.820 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T11:46:54.826 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:46:54.826 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T11:46:54.875 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.875 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T11:46:54.881 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:46:54.881 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T11:46:54.926 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T11:46:54.926 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T11:46:54.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCNMeBmhjMvIRAAiIXttz5al6mSEZeTpxjXeA== 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCNMeBmmk0eKRAAQ8PFSWhrm1c6PQvWkgFK1w== 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCNMeBmH0FkMRAArFXfXEA+T6j4FvpP5ewQhw== 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCRMeBm8WCkERAAS9Tf8bSWrN0PsSlCiF8OZw== 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCUMeBmLLbJHxAAEstcyO402E+1Q9l29XDqpQ== 2024-09-10T11:46:54.972 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCXMeBmG7aVLxAA1+5hXJsW3DMUROpwYlthWA== 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCbMeBm1wHhBBAAqh8UE95805v5QKP30F333g== 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCNMeBm4MchJBAAk1lTl41AoNAIaOaf+C0q1w== 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCNMeBmX/qyNxAAHAOSIm5LQI9va2i2KtVQBg== 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCOMeBmoYnzARAAMpEd1i1vS73hZSJO4bR8RQ== 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQChMeBmnG5DDBAAW7cbxDHTZ2e6Ze4uf7Naeg== 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-09-10T11:46:54.973 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCkMeBmkaqDGRAAFFPmLeogntOVoX8dd5f8yQ== 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCnMeBmDDJRKxAAqRYVsfMT4oXW74HJPB/teQ== 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCqMeBmzbp9OBAAE3VnbN/tsa9u0/RTa14CXQ== 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCOMeBmH8SIBxAARk8yUg7dJLUAyM/P/HBIjw== 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout:[client.2] 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCOMeBmqw+PDBAAp+LQ9VDYNE9DY7FROnDwww== 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCOMeBmye5sDxAA24x+m4hQJP/vc6TZaIB/gg== 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout:[client.3] 2024-09-10T11:46:54.974 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCOMeBmCOd+FBAAJHwHJRh1xETp9483z1NWxw== 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCNMeBmhjMvIRAAiIXttz5al6mSEZeTpxjXeA== 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCNMeBmmk0eKRAAQ8PFSWhrm1c6PQvWkgFK1w== 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCNMeBmH0FkMRAArFXfXEA+T6j4FvpP5ewQhw== 2024-09-10T11:46:54.980 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCRMeBm8WCkERAAS9Tf8bSWrN0PsSlCiF8OZw== 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCUMeBmLLbJHxAAEstcyO402E+1Q9l29XDqpQ== 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCXMeBmG7aVLxAA1+5hXJsW3DMUROpwYlthWA== 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCbMeBm1wHhBBAAqh8UE95805v5QKP30F333g== 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCNMeBm4MchJBAAk1lTl41AoNAIaOaf+C0q1w== 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCNMeBmX/qyNxAAHAOSIm5LQI9va2i2KtVQBg== 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-10T11:46:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOMeBmoYnzARAAMpEd1i1vS73hZSJO4bR8RQ== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQChMeBmnG5DDBAAW7cbxDHTZ2e6Ze4uf7Naeg== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCkMeBmkaqDGRAAFFPmLeogntOVoX8dd5f8yQ== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCnMeBmDDJRKxAAqRYVsfMT4oXW74HJPB/teQ== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCqMeBmzbp9OBAAE3VnbN/tsa9u0/RTa14CXQ== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOMeBmH8SIBxAARk8yUg7dJLUAyM/P/HBIjw== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOMeBmqw+PDBAAp+LQ9VDYNE9DY7FROnDwww== 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-10T11:46:54.982 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOMeBmye5sDxAA24x+m4hQJP/vc6TZaIB/gg== 2024-09-10T11:46:54.983 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2024-09-10T11:46:54.983 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOMeBmCOd+FBAAJHwHJRh1xETp9483z1NWxw== 2024-09-10T11:46:54.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:46:55.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:46:55.070 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.495 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:46:55.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:46:55.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:46:55.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:55.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:56.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:56.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:56.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:46:56.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.407 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:46:56.453 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T11:46:56.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T11:46:56.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T11:46:56.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T11:46:56.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T11:46:56.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T11:46:56.677 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T11:46:56.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T11:46:56.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T11:46:56.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T11:46:56.845 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:56.848 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:46:56.893 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T11:46:56.893 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T11:46:56.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T11:46:56.896 INFO:tasks.ceph.mon.a:Started 2024-09-10T11:46:56.896 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T11:46:56.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T11:46:56.938 INFO:tasks.ceph.mon.b:Started 2024-09-10T11:46:56.939 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T11:46:56.939 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T11:46:56.941 INFO:tasks.ceph.mon.c:Started 2024-09-10T11:46:56.941 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T11:46:56.941 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T11:46:56.941 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T11:46:56.944 INFO:tasks.ceph.mgr.y:Started 2024-09-10T11:46:56.944 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T11:46:56.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T11:46:56.946 INFO:tasks.ceph.mgr.x:Started 2024-09-10T11:46:56.946 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T11:46:56.947 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T11:46:56.949 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T11:46:56.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T11:46:56.998 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T11:46:56.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T11:46:57.042 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T11:46:57.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T11:46:57.091 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T11:46:57.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T11:46:57.135 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T11:46:57.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T11:46:57.179 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T11:46:57.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T11:46:57.227 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T11:46:57.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T11:46:57.270 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T11:46:57.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T11:46:57.315 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T11:46:57.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T11:46:57.362 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T11:46:57.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T11:46:57.406 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T11:46:57.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T11:46:57.454 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T11:46:57.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T11:46:57.498 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T11:46:57.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T11:46:57.542 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T11:46:57.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T11:46:57.586 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T11:46:57.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T11:46:57.630 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T11:46:57.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T11:46:57.679 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T11:46:57.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T11:46:57.722 DEBUG:tasks.ceph:set 18 configs 2024-09-10T11:46:57.723 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi078') 2024-09-10T11:47:02.635 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi078') 2024-09-10T11:47:02.635 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 -- 172.21.15.78:0/812722127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf88070840 msgr2=0x7fdf880b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 --2- 172.21.15.78:0/812722127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf88070840 0x7fdf880b16e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01b0a0 tx=0x7fdf7c01ccd0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 -- 172.21.15.78:0/812722127 shutdown_connections 2024-09-10T11:47:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 --2- 172.21.15.78:0/812722127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf88073900 0x7fdf880b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 --2- 172.21.15.78:0/812722127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf88070840 0x7fdf880b16e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 --2- 172.21.15.78:0/812722127 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7400ca10 0x7fdf880cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 -- 172.21.15.78:0/812722127 >> 172.21.15.78:0/812722127 conn(0x7fdf880b27c0 msgr2=0x7fdf8815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 -- 172.21.15.78:0/812722127 shutdown_connections 2024-09-10T11:47:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.231+0000 7fdf8d86d640 1 -- 172.21.15.78:0/812722127 wait complete. 2024-09-10T11:47:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- 172.21.15.78:0/975752211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1138004d50 msgr2=0x7f11380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 --2- 172.21.15.78:0/975752211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1138004d50 0x7f11380051d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f114c06f060 tx=0x7f113c01cfb0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114bfff640 1 -- 172.21.15.78:0/975752211 reap_dead start 2024-09-10T11:47:03.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- 172.21.15.78:0/975752211 shutdown_connections 2024-09-10T11:47:03.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- 172.21.15.78:0/975752211 >> 172.21.15.78:0/975752211 conn(0x7f114c0b27c0 msgr2=0x7f114c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- 172.21.15.78:0/975752211 shutdown_connections 2024-09-10T11:47:03.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- 172.21.15.78:0/975752211 wait complete. 2024-09-10T11:47:03.253 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 Processor -- start 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- start start 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 0x7f114c0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f114c0cd8d0 0x7f114c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f114c0cfa10 0x7f114c1f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f114c0731f0 con 0x7f114c0af070 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f114c06ca00 con 0x7f114c0cfa10 2024-09-10T11:47:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f1151b5a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f114c073370 con 0x7f114c0cd8d0 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 0x7f114c0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 0x7f114c0cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44232/0 (socket says 172.21.15.78:44232) 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 -- 172.21.15.78:0/470551951 learned_addr learned my addr 172.21.15.78:0/470551951 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114bfff640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f114c0cfa10 0x7f114c1f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114affd640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f114c0cd8d0 0x7f114c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 -- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f114c0cd8d0 msgr2=0x7f114c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f114c0cd8d0 0x7f114c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 -- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f114c0cfa10 msgr2=0x7f114c1f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f114c0cfa10 0x7f114c1f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 -- 172.21.15.78:0/470551951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c0d0240 con 0x7f114c0af070 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114bfff640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f114c0cfa10 0x7f114c1f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.247+0000 7f114b7fe640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 0x7f114c0cd390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1144012a70 tx=0x7f1144012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144022020 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f1144010ca0 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114c145360 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114401e650 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114c145920 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1144025020 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f114401ec30 con 0x7f114c0af070 2024-09-10T11:47:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114c070390 con 0x7f114c0af070 2024-09-10T11:47:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.251+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f114402c030 con 0x7f114c0af070 2024-09-10T11:47:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7f2f40e6b640 1 -- 172.21.15.78:0/1983037136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f2f3c15f610 con 0x7f2f1c006bc0 2024-09-10T11:47:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 -- 172.21.15.78:0/1640761078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03c006b60 msgr2=0x7fc03c007010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1640761078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03c006b60 0x7fc03c007010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc05806ff40 tx=0x7fc05001c730 comp rx=0 tx=0).stop 2024-09-10T11:47:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 -- 172.21.15.78:0/1640761078 shutdown_connections 2024-09-10T11:47:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1640761078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03c006b60 0x7fc03c007010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1640761078 >> v2:172.21.15.112:3300/0 conn(0x7fc03c003b40 0x7fc03c006620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 -- 172.21.15.78:0/1640761078 >> 172.21.15.78:0/1640761078 conn(0x7fc0580b1c70 msgr2=0x7fc0580b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 -- 172.21.15.78:0/1640761078 shutdown_connections 2024-09-10T11:47:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 -- 172.21.15.78:0/1640761078 wait complete. 2024-09-10T11:47:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 Processor -- start 2024-09-10T11:47:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7fc05ec27640 1 -- start start 2024-09-10T11:47:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.291+0000 7f2f2affd640 1 -- 172.21.15.78:0/1983037136 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f2f30004a30 con 0x7f2f1c006bc0 2024-09-10T11:47:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 0x7fc0580b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc03c006b60 0x7fc0581f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580cddb0 0x7fc0580c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0580ce340 con 0x7fc0580cddb0 2024-09-10T11:47:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc0580ce1c0 con 0x7fc03c006b60 2024-09-10T11:47:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc0580ce4c0 con 0x7fc03c003b40 2024-09-10T11:47:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f2affd640 1 -- 172.21.15.78:0/1983037136 <== mon.0 v2:172.21.15.78:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f2f30004d30 con 0x7f2f1c006bc0 2024-09-10T11:47:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f11440263b0 con 0x7f114c0af070 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 0x7fc0580b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 0x7fc0580b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.78:50946/0 (socket says 172.21.15.78:50946) 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 -- 172.21.15.78:0/1533170674 learned_addr learned my addr 172.21.15.78:0/1533170674 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05d1c4640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580cddb0 0x7fc0580c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 -- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc03c006b60 msgr2=0x7fc0581f96c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc03c006b60 0x7fc0581f96c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 -- 172.21.15.78:0/1533170674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580cddb0 msgr2=0x7fc0580c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 -- 172.21.15.78:0/1983037136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1c006bc0 msgr2=0x7f2f3c0ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 --2- 172.21.15.78:0/1983037136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1c006bc0 0x7f2f3c0ce560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2f30011a90 tx=0x7f2f30011f50 comp rx=0 tx=0).stop 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 -- 172.21.15.78:0/1983037136 shutdown_connections 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 --2- 172.21.15.78:0/1983037136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0086c0 0x7f2f3c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 --2- 172.21.15.78:0/1983037136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1c006bc0 0x7f2f3c0ce560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 --2- 172.21.15.78:0/1983037136 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f1c003b90 0x7f2f3c14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 -- 172.21.15.78:0/1983037136 >> 172.21.15.78:0/1983037136 conn(0x7f2f3c0b27c0 msgr2=0x7f2f3c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580cddb0 0x7fc0580c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 -- 172.21.15.78:0/1533170674 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0581578a0 con 0x7fc03c003b40 2024-09-10T11:47:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05d1c4640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580cddb0 0x7fc0580c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 -- 172.21.15.78:0/1983037136 shutdown_connections 2024-09-10T11:47:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7f2f40e6b640 1 -- 172.21.15.78:0/1983037136 wait complete. 2024-09-10T11:47:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05c9c3640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 0x7fc0580b4980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc04c004660 tx=0x7fc04c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00dd40 con 0x7fc03c003b40 2024-09-10T11:47:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0580b38e0 con 0x7fc03c003b40 2024-09-10T11:47:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fc04c01f070 con 0x7fc03c003b40 2024-09-10T11:47:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c01a6e0 con 0x7fc03c003b40 2024-09-10T11:47:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0580b3ea0 con 0x7fc03c003b40 2024-09-10T11:47:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc04c01a880 con 0x7fc03c003b40 2024-09-10T11:47:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc04c024c00 con 0x7fc03c003b40 2024-09-10T11:47:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.295+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0580ce8f0 con 0x7fc03c003b40 2024-09-10T11:47:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.303+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc04c015050 con 0x7fc03c003b40 2024-09-10T11:47:03.315 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 -- 172.21.15.78:0/3892563826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384008820 msgr2=0x7f838400d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 --2- 172.21.15.78:0/3892563826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384008820 0x7f838400d330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83980b5c80 tx=0x7f839001d920 comp rx=0 tx=0).stop 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 -- 172.21.15.78:0/3892563826 shutdown_connections 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 --2- 172.21.15.78:0/3892563826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384008820 0x7f838400d330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 --2- 172.21.15.78:0/3892563826 >> v2:172.21.15.112:3300/0 conn(0x7f8384003b80 0x7f83840066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 -- 172.21.15.78:0/3892563826 >> 172.21.15.78:0/3892563826 conn(0x7f83980b27c0 msgr2=0x7f83980b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 -- 172.21.15.78:0/3892563826 shutdown_connections 2024-09-10T11:47:03.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 -- 172.21.15.78:0/3892563826 wait complete. 2024-09-10T11:47:03.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.335+0000 7f839da15640 1 Processor -- start 2024-09-10T11:47:03.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- start start 2024-09-10T11:47:03.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8384003b80 0x7f839815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 0x7f839815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8384008820 0x7f83981f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83980af520 con 0x7f8384006bf0 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f839806fbb0 con 0x7f8384003b80 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f83980af6a0 con 0x7f8384008820 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 0x7f839815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 0x7f839815d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44276/0 (socket says 172.21.15.78:44276) 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 -- 172.21.15.78:0/1283771560 learned_addr learned my addr 172.21.15.78:0/1283771560 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f8396ffd640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8384003b80 0x7f839815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83977fe640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8384008820 0x7f83981f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 -- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8384008820 msgr2=0x7f83981f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8384008820 0x7f83981f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 -- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8384003b80 msgr2=0x7f839815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8384003b80 0x7f839815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 -- 172.21.15.78:0/1283771560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83981f3d60 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f8396ffd640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8384003b80 0x7f839815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f83967fc640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 0x7f839815d410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f838c000c10 tx=0x7f838c014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c012650 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f838c0128c0 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83981f4040 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c012c90 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839814a590 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f838c026440 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f838c01da90 con 0x7f8384006bf0 2024-09-10T11:47:03.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.339+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83980afb40 con 0x7f8384006bf0 2024-09-10T11:47:03.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.343+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f838c0268c0 con 0x7f8384006bf0 2024-09-10T11:47:03.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.355+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f114c15c090 con 0x7f114c0af070 2024-09-10T11:47:03.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.359+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f1144026580 con 0x7f114c0af070 2024-09-10T11:47:03.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.359+0000 7f1143fff640 1 -- 172.21.15.78:0/470551951 <== mon.0 v2:172.21.15.78:3300/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1144026820 con 0x7f114c0af070 2024-09-10T11:47:03.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.359+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f838c012e30 con 0x7f8384006bf0 2024-09-10T11:47:03.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 msgr2=0x7f114c0cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 0x7f114c0cd390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1144012a70 tx=0x7f1144012f30 comp rx=0 tx=0).stop 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 shutdown_connections 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f114c0cfa10 0x7f114c1f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f114c0cd8d0 0x7f114c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 --2- 172.21.15.78:0/470551951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f114c0af070 0x7f114c0cd390 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 >> 172.21.15.78:0/470551951 conn(0x7f114c0b27c0 msgr2=0x7f114c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 shutdown_connections 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7f1151b5a640 1 -- 172.21.15.78:0/470551951 wait complete. 2024-09-10T11:47:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.363+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc04c024e50 con 0x7fc03c003b40 2024-09-10T11:47:03.389 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.391+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fc05809dc90 con 0x7fc03c003b40 2024-09-10T11:47:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.395+0000 7fc0557fa640 1 -- 172.21.15.78:0/1533170674 <== mon.2 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v16)=0 v16) ==== 108+0+0 (secure 0 0 0) 0x7fc04c01ad50 con 0x7fc03c003b40 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 msgr2=0x7fc0580b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 0x7fc0580b4980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc04c004660 tx=0x7fc04c00cef0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 shutdown_connections 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc03c006b60 0x7fc0581f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580cddb0 0x7fc0580c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 --2- 172.21.15.78:0/1533170674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc03c003b40 0x7fc0580b4980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 >> 172.21.15.78:0/1533170674 conn(0x7fc0580b1c70 msgr2=0x7fc0580b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 shutdown_connections 2024-09-10T11:47:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.399+0000 7fc05ec27640 1 -- 172.21.15.78:0/1533170674 wait complete. 2024-09-10T11:47:03.417 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f8398154980 con 0x7f8384006bf0 2024-09-10T11:47:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f837ffff640 1 -- 172.21.15.78:0/1283771560 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7f838c026b00 con 0x7f8384006bf0 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 msgr2=0x7f839815d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 0x7f839815d410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f838c000c10 tx=0x7f838c014830 comp rx=0 tx=0).stop 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 shutdown_connections 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8384008820 0x7f83981f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8384006bf0 0x7f839815d410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 --2- 172.21.15.78:0/1283771560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8384003b80 0x7f839815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 >> 172.21.15.78:0/1283771560 conn(0x7f83980b27c0 msgr2=0x7f8398073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 shutdown_connections 2024-09-10T11:47:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.415+0000 7f839da15640 1 -- 172.21.15.78:0/1283771560 wait complete. 2024-09-10T11:47:03.436 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.436 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.436 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.436 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 -- 172.21.15.78:0/486452405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580cf380 msgr2=0x7f754400b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 --2- 172.21.15.78:0/486452405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580cf380 0x7f754400b280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75580af3e0 tx=0x7f754801d750 comp rx=0 tx=0).stop 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 -- 172.21.15.78:0/486452405 shutdown_connections 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 --2- 172.21.15.78:0/486452405 >> v2:172.21.15.112:3300/0 conn(0x7f7544003b20 0x7f7544006630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 --2- 172.21.15.78:0/486452405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580cf380 0x7f754400b280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 -- 172.21.15.78:0/486452405 >> 172.21.15.78:0/486452405 conn(0x7f75580b1c70 msgr2=0x7f75580b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 -- 172.21.15.78:0/486452405 shutdown_connections 2024-09-10T11:47:03.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 -- 172.21.15.78:0/486452405 wait complete. 2024-09-10T11:47:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 Processor -- start 2024-09-10T11:47:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.519+0000 7f755d241640 1 -- start start 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 0x7f755815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7544006b70 0x7f75581f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75580cf380 0x7f75581f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f755806eb20 con 0x7f7544003b20 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f755806e9a0 con 0x7f75580cf380 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f755806eca0 con 0x7f7544006b70 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 0x7f755815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 0x7f755815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44302/0 (socket says 172.21.15.78:44302) 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 -- 172.21.15.78:0/4034035065 learned_addr learned my addr 172.21.15.78:0/4034035065 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755659c640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7544006b70 0x7f75581f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755759e640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75580cf380 0x7f75581f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 -- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7544006b70 msgr2=0x7f75581f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7544006b70 0x7f75581f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 -- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75580cf380 msgr2=0x7f75581f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75580cf380 0x7f75581f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 -- 172.21.15.78:0/4034035065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75580c4e70 con 0x7f7544003b20 2024-09-10T11:47:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f7556d9d640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 0x7f755815a030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f754801b380 tx=0x7f75480b0630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75480ac040 con 0x7f7544003b20 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75480bf070 con 0x7f7544003b20 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75480ba430 con 0x7f7544003b20 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75581f5b90 con 0x7f7544003b20 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755815ca50 con 0x7f7544003b20 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f75480b7070 con 0x7f7544003b20 2024-09-10T11:47:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f75480bac80 con 0x7f7544003b20 2024-09-10T11:47:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.523+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75580ce6f0 con 0x7f7544003b20 2024-09-10T11:47:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.527+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f75480174a0 con 0x7f7544003b20 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 -- 172.21.15.78:0/3992787102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65480092a0 msgr2=0x7f654800b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 --2- 172.21.15.78:0/3992787102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65480092a0 0x7f654800b690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6560006b30 tx=0x7f656001d770 comp rx=0 tx=0).stop 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 -- 172.21.15.78:0/3992787102 shutdown_connections 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 --2- 172.21.15.78:0/3992787102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65480092a0 0x7f654800b690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 -- 172.21.15.78:0/3992787102 >> 172.21.15.78:0/3992787102 conn(0x7f656409aa60 msgr2=0x7f656409ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 -- 172.21.15.78:0/3992787102 shutdown_connections 2024-09-10T11:47:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.559+0000 7f656b270640 1 -- 172.21.15.78:0/3992787102 wait complete. 2024-09-10T11:47:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 Processor -- start 2024-09-10T11:47:03.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 -- start start 2024-09-10T11:47:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 0x7f65640b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548007d80 0x7f65641fb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65480092a0 0x7f6564157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f65640ceed0 con 0x7f6548003b70 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f65640ced50 con 0x7f6548007d80 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f65640cf050 con 0x7f65480092a0 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 0x7f65640b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 0x7f65640b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44326/0 (socket says 172.21.15.78:44326) 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 -- 172.21.15.78:0/3474715350 learned_addr learned my addr 172.21.15.78:0/3474715350 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656880b640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548007d80 0x7f65641fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656980d640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65480092a0 0x7f6564157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 -- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65480092a0 msgr2=0x7f6564157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65480092a0 0x7f6564157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 -- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548007d80 msgr2=0x7f65641fb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548007d80 0x7f65641fb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 -- 172.21.15.78:0/3474715350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65640b6410 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656900c640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 0x7f65640b6bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f656001a380 tx=0x7f6560000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65600af040 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65600b4450 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6564158350 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65600b4840 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.563+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65640b7260 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.567+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65600b2070 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.567+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f65600a8ac0 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.567+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65640cfd10 con 0x7f6548003b70 2024-09-10T11:47:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.567+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f65600c4060 con 0x7f6548003b70 2024-09-10T11:47:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.583+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7558158bb0 con 0x7f7544003b20 2024-09-10T11:47:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f753f7fe640 1 -- 172.21.15.78:0/4034035065 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f75480ba5d0 con 0x7f7544003b20 2024-09-10T11:47:03.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 msgr2=0x7f755815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 0x7f755815a030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f754801b380 tx=0x7f75480b0630 comp rx=0 tx=0).stop 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 shutdown_connections 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75580cf380 0x7f75581f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7544006b70 0x7f75581f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 --2- 172.21.15.78:0/4034035065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7544003b20 0x7f755815a030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 >> 172.21.15.78:0/4034035065 conn(0x7f75580b1c70 msgr2=0x7f75580cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 shutdown_connections 2024-09-10T11:47:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.591+0000 7f755d241640 1 -- 172.21.15.78:0/4034035065 wait complete. 2024-09-10T11:47:03.611 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.627+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f65640d0810 con 0x7f6548003b70 2024-09-10T11:47:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.631+0000 7f6559ffb640 1 -- 172.21.15.78:0/3474715350 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7f65600174c0 con 0x7f6548003b70 2024-09-10T11:47:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 msgr2=0x7f65640b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 0x7f65640b6bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f656001a380 tx=0x7f6560000ee0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 shutdown_connections 2024-09-10T11:47:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548007d80 0x7f65641fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65480092a0 0x7f6564157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 --2- 172.21.15.78:0/3474715350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548003b70 0x7f65640b6bd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 >> 172.21.15.78:0/3474715350 conn(0x7f656409aa60 msgr2=0x7f656409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 shutdown_connections 2024-09-10T11:47:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.635+0000 7f656b270640 1 -- 172.21.15.78:0/3474715350 wait complete. 2024-09-10T11:47:03.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-10T11:47:03.654 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T11:47:03.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T11:47:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 -- 172.21.15.78:0/2503547494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 msgr2=0x7f0e58073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/2503547494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e58073620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0e5815cfb0 tx=0x7f0e5001ccd0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 -- 172.21.15.78:0/2503547494 shutdown_connections 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/2503547494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e58073620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/2503547494 >> v2:172.21.15.112:3300/0 conn(0x7f0e5806d560 0x7f0e5806d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 -- 172.21.15.78:0/2503547494 >> 172.21.15.78:0/2503547494 conn(0x7f0e580b27c0 msgr2=0x7f0e580b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 -- 172.21.15.78:0/2503547494 shutdown_connections 2024-09-10T11:47:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.799+0000 7f0e5f10c640 1 -- 172.21.15.78:0/2503547494 wait complete. 2024-09-10T11:47:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 Processor -- start 2024-09-10T11:47:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- start start 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5806d560 0x7f0e5814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e581471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e58155e40 0x7f0e5814b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0e580af8b0 con 0x7f0e580731f0 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0e580af730 con 0x7f0e5806d560 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0e580afa30 con 0x7f0e58155e40 2024-09-10T11:47:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e581471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e581471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44342/0 (socket says 172.21.15.78:44342) 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 -- 172.21.15.78:0/3318293365 learned_addr learned my addr 172.21.15.78:0/3318293365 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5cea8640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5806d560 0x7f0e5814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5d6a9640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e58155e40 0x7f0e5814b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 -- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e58155e40 msgr2=0x7f0e5814b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e58155e40 0x7f0e5814b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 -- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5806d560 msgr2=0x7f0e5814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5806d560 0x7f0e5814da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 -- 172.21.15.78:0/3318293365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e581484f0 con 0x7f0e580731f0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e57fff640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e581471d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c940 tx=0x7f0e4400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004220 con 0x7f0e580731f0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e440079b0 con 0x7f0e580731f0 2024-09-10T11:47:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e58147c50 con 0x7f0e580731f0 2024-09-10T11:47:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e440044b0 con 0x7f0e580731f0 2024-09-10T11:47:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e58148210 con 0x7f0e580731f0 2024-09-10T11:47:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e440053b0 con 0x7f0e580731f0 2024-09-10T11:47:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e440038c0 con 0x7f0e580731f0 2024-09-10T11:47:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.803+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e580aff80 con 0x7f0e580731f0 2024-09-10T11:47:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.807+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0e44014030 con 0x7f0e580731f0 2024-09-10T11:47:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.867+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0e58152f00 con 0x7f0e580731f0 2024-09-10T11:47:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e557fa640 1 -- 172.21.15.78:0/3318293365 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0e44007de0 con 0x7f0e580731f0 2024-09-10T11:47:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-10T11:47:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 msgr2=0x7f0e581471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e581471d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c940 tx=0x7f0e4400ce00 comp rx=0 tx=0).stop 2024-09-10T11:47:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 shutdown_connections 2024-09-10T11:47:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e58155e40 0x7f0e5814b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e580731f0 0x7f0e581471d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 --2- 172.21.15.78:0/3318293365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5806d560 0x7f0e5814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 >> 172.21.15.78:0/3318293365 conn(0x7f0e580b27c0 msgr2=0x7f0e5806dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 shutdown_connections 2024-09-10T11:47:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:03.871+0000 7f0e5f10c640 1 -- 172.21.15.78:0/3318293365 wait complete. 2024-09-10T11:47:03.891 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T11:47:03.891 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T11:47:03.892 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:47:03.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T11:47:03.902 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:47:03.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T11:47:03.957 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:47:03.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T11:47:04.009 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T11:47:04.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T11:47:04.060 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:47:04.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T11:47:04.074 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:47:04.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T11:47:04.130 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:47:04.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T11:47:04.184 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T11:47:04.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T11:47:04.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 4be7965a-1b2b-4583-9122-8b52e911393e 0 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/2153874837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0b3b60 msgr2=0x7f2d7c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 --2- 172.21.15.112:0/2153874837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0b3b60 0x7f2d7c15e3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009900 tx=0x7f2d7001c8e0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/2153874837 shutdown_connections 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 --2- 172.21.15.112:0/2153874837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0b3b60 0x7f2d7c15e3c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 --2- 172.21.15.112:0/2153874837 >> v2:172.21.15.112:3300/0 conn(0x7f2d7c0cff30 0x7f2d7c0d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/2153874837 >> 172.21.15.112:0/2153874837 conn(0x7f2d7c0b27c0 msgr2=0x7f2d7c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/2153874837 shutdown_connections 2024-09-10T11:47:04.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/2153874837 wait complete. 2024-09-10T11:47:04.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 Processor -- start 2024-09-10T11:47:04.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- start start 2024-09-10T11:47:04.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 0x7f2d7c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0cff30 0x7f2d7c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c15b6c0 0x7f2d7c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0af6a0 con 0x7f2d7c15b6c0 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0af520 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c0af820 con 0x7f2d7c0cff30 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 0x7f2d7c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7a7fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0cff30 0x7f2d7c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 0x7f2d7c151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55408/0 (socket says 172.21.15.112:55408) 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 -- 172.21.15.112:0/1959243199 learned_addr learned my addr 172.21.15.112:0/1959243199 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 -- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0cff30 msgr2=0x7f2d7c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0cff30 0x7f2d7c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 -- 172.21.15.112:0/1959243199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c15b6c0 msgr2=0x7f2d7c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7b7fe640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c15b6c0 0x7f2d7c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c15b6c0 0x7f2d7c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 -- 172.21.15.112:0/1959243199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c154070 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7b7fe640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c15b6c0 0x7f2d7c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d7affd640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 0x7f2d7c151a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00e940 tx=0x7f2d6c00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00cd80 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d6c005020 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c1503f0 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c005450 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c1509b0 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d6c004b40 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.403+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2d6c018770 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.407+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7c15e3c0 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.407+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2d6c0055f0 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.479+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4be7965a-1b2b-4583-9122-8b52e911393e", "id": 0} v 0) -- 0x7f2d7c069380 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d63fff640 1 -- 172.21.15.112:0/1959243199 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4be7965a-1b2b-4583-9122-8b52e911393e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2d6c021d40 con 0x7f2d7c0b3b60 2024-09-10T11:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout:0 2024-09-10T11:47:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 msgr2=0x7f2d7c151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 0x7f2d7c151a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00e940 tx=0x7f2d6c00ee00 comp rx=0 tx=0).stop 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 shutdown_connections 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c15b6c0 0x7f2d7c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d7c0cff30 0x7f2d7c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 --2- 172.21.15.112:0/1959243199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d7c0b3b60 0x7f2d7c151a20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 >> 172.21.15.112:0/1959243199 conn(0x7f2d7c0b27c0 msgr2=0x7f2d7c15c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 shutdown_connections 2024-09-10T11:47:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.487+0000 7f2d81826640 1 -- 172.21.15.112:0/1959243199 wait complete. 2024-09-10T11:47:04.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 3ec6f299-f672-495a-98a9-a6ac33a08989 1 2024-09-10T11:47:04.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 -- 172.21.15.112:0/3501022154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 msgr2=0x7f21a40b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 --2- 172.21.15.112:0/3501022154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b16c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21a40b3490 tx=0x7f219801c7d0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 -- 172.21.15.112:0/3501022154 shutdown_connections 2024-09-10T11:47:04.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 --2- 172.21.15.112:0/3501022154 >> v2:172.21.15.78:3300/0 conn(0x7f21a40d20d0 0x7f21a40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 --2- 172.21.15.112:0/3501022154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b16c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 -- 172.21.15.112:0/3501022154 >> 172.21.15.112:0/3501022154 conn(0x7f21a409aa60 msgr2=0x7f21a409ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:04.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 -- 172.21.15.112:0/3501022154 shutdown_connections 2024-09-10T11:47:04.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.623+0000 7f21aacbe640 1 -- 172.21.15.112:0/3501022154 wait complete. 2024-09-10T11:47:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 Processor -- start 2024-09-10T11:47:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- start start 2024-09-10T11:47:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a40d20d0 0x7f21a4148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a415ef90 0x7f21a4148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4168840 con 0x7f21a415ef90 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f21a41686c0 con 0x7f21a40ae780 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f21a41689c0 con 0x7f21a40d20d0 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55430/0 (socket says 172.21.15.112:55430) 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a3fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a40d20d0 0x7f21a4148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 -- 172.21.15.112:0/802000740 learned_addr learned my addr 172.21.15.112:0/802000740 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a925b640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a415ef90 0x7f21a4148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 -- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a40d20d0 msgr2=0x7f21a4148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a40d20d0 0x7f21a4148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 -- 172.21.15.112:0/802000740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a415ef90 msgr2=0x7f21a4148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a415ef90 0x7f21a4148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 -- 172.21.15.112:0/802000740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a41f98e0 con 0x7f21a40ae780 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a3fff640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a40d20d0 0x7f21a4148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a925b640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a415ef90 0x7f21a4148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a8a5a640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b3f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c750 tx=0x7f219c00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c017070 con 0x7f21a40ae780 2024-09-10T11:47:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219c005070 con 0x7f21a40ae780 2024-09-10T11:47:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c00ce60 con 0x7f21a40ae780 2024-09-10T11:47:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a41f8d60 con 0x7f21a40ae780 2024-09-10T11:47:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a41f9320 con 0x7f21a40ae780 2024-09-10T11:47:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f219c01a070 con 0x7f21a40ae780 2024-09-10T11:47:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f219c01c7f0 con 0x7f21a40ae780 2024-09-10T11:47:04.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.627+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a40d19c0 con 0x7f21a40ae780 2024-09-10T11:47:04.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.631+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f219c021070 con 0x7f21a40ae780 2024-09-10T11:47:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.699+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ec6f299-f672-495a-98a9-a6ac33a08989", "id": 1} v 0) -- 0x7f21a40b1290 con 0x7f21a40ae780 2024-09-10T11:47:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21a17fa640 1 -- 172.21.15.112:0/802000740 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ec6f299-f672-495a-98a9-a6ac33a08989", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f219c0054c0 con 0x7f21a40ae780 2024-09-10T11:47:04.709 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 msgr2=0x7f21a40b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b3f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c750 tx=0x7f219c00cc10 comp rx=0 tx=0).stop 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 shutdown_connections 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a415ef90 0x7f21a4148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a40d20d0 0x7f21a4148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 --2- 172.21.15.112:0/802000740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a40ae780 0x7f21a40b3f20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.707+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 >> 172.21.15.112:0/802000740 conn(0x7f21a409aa60 msgr2=0x7f21a4155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.711+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 shutdown_connections 2024-09-10T11:47:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.711+0000 7f21aacbe640 1 -- 172.21.15.112:0/802000740 wait complete. 2024-09-10T11:47:04.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 62160ac2-9b11-4b6f-a0b9-5b6543c24522 2 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 -- 172.21.15.112:0/2540612472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f620415b6c0 msgr2=0x7f620406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 --2- 172.21.15.112:0/2540612472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f620415b6c0 0x7f620406da60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009c80 tx=0x7f61fc01cda0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 -- 172.21.15.112:0/2540612472 shutdown_connections 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 --2- 172.21.15.112:0/2540612472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f620415b6c0 0x7f620406da60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 --2- 172.21.15.112:0/2540612472 >> v2:172.21.15.78:3300/0 conn(0x7f62040b3b60 0x7f62040d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 -- 172.21.15.112:0/2540612472 >> 172.21.15.112:0/2540612472 conn(0x7f62040b27c0 msgr2=0x7f62040b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 -- 172.21.15.112:0/2540612472 shutdown_connections 2024-09-10T11:47:04.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.839+0000 7f620c485640 1 -- 172.21.15.112:0/2540612472 wait complete. 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 Processor -- start 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- start start 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62040b3b60 0x7f6204149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 0x7f62041f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 0x7f62041599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62040afa70 con 0x7f62040b3b60 2024-09-10T11:47:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62040af8f0 con 0x7f620415b6c0 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f62040afbf0 con 0x7f62040cff30 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 0x7f62041f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620aa22640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 0x7f62041599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 0x7f62041f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40760/0 (socket says 172.21.15.112:40760) 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620aa22640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 0x7f62041599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55434/0 (socket says 172.21.15.112:55434) 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 -- 172.21.15.112:0/357816499 learned_addr learned my addr 172.21.15.112:0/357816499 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620a221640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62040b3b60 0x7f6204149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 -- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 msgr2=0x7f62041599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 0x7f62041599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 -- 172.21.15.112:0/357816499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62040b3b60 msgr2=0x7f6204149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62040b3b60 0x7f6204149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 -- 172.21.15.112:0/357816499 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620414f3b0 con 0x7f62040cff30 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620aa22640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 0x7f62041599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620a221640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62040b3b60 0x7f6204149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f6209a20640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 0x7f62041f5930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61f400b550 tx=0x7f61f400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4014070 con 0x7f62040cff30 2024-09-10T11:47:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61f4010980 con 0x7f62040cff30 2024-09-10T11:47:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620414f650 con 0x7f62040cff30 2024-09-10T11:47:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f620414fc10 con 0x7f62040cff30 2024-09-10T11:47:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4010dd0 con 0x7f62040cff30 2024-09-10T11:47:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61f4017070 con 0x7f62040cff30 2024-09-10T11:47:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f61f400f970 con 0x7f62040cff30 2024-09-10T11:47:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.843+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62040b00e0 con 0x7f62040cff30 2024-09-10T11:47:04.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.847+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f61f400f550 con 0x7f62040cff30 2024-09-10T11:47:04.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.915+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "62160ac2-9b11-4b6f-a0b9-5b6543c24522", "id": 2} v 0) -- 0x7f620414ab40 con 0x7f62040cff30 2024-09-10T11:47:04.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f61faffd640 1 -- 172.21.15.112:0/357816499 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62160ac2-9b11-4b6f-a0b9-5b6543c24522", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f61f400fbc0 con 0x7f62040cff30 2024-09-10T11:47:04.923 INFO:teuthology.orchestra.run.smithi112.stdout:2 2024-09-10T11:47:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 msgr2=0x7f62041f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 0x7f62041f5930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61f400b550 tx=0x7f61f400ba10 comp rx=0 tx=0).stop 2024-09-10T11:47:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 shutdown_connections 2024-09-10T11:47:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f620415b6c0 0x7f62041599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62040cff30 0x7f62041f5930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 --2- 172.21.15.112:0/357816499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62040b3b60 0x7f6204149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 >> 172.21.15.112:0/357816499 conn(0x7f62040b27c0 msgr2=0x7f62040b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 shutdown_connections 2024-09-10T11:47:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:04.923+0000 7f620c485640 1 -- 172.21.15.112:0/357816499 wait complete. 2024-09-10T11:47:04.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 052b01fd-4b1c-44da-a1e1-ebd67f9a8e41 3 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 -- 172.21.15.112:0/2225332367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 msgr2=0x7fd2080b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 --2- 172.21.15.112:0/2225332367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd2080b2dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009900 tx=0x7fd1f801c8e0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 -- 172.21.15.112:0/2225332367 shutdown_connections 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 --2- 172.21.15.112:0/2225332367 >> v2:172.21.15.78:3300/0 conn(0x7fd208160380 0x7fd2080d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 --2- 172.21.15.112:0/2225332367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd2080b2dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 -- 172.21.15.112:0/2225332367 >> 172.21.15.112:0/2225332367 conn(0x7fd20809aa60 msgr2=0x7fd2080d1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 -- 172.21.15.112:0/2225332367 shutdown_connections 2024-09-10T11:47:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.083+0000 7fd20d052640 1 -- 172.21.15.112:0/2225332367 wait complete. 2024-09-10T11:47:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 Processor -- start 2024-09-10T11:47:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- start start 2024-09-10T11:47:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2080b1030 0x7fd208166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd20806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd208160380 0x7fd2080aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd208169280 con 0x7fd2080b1030 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd208169100 con 0x7fd208160380 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd208169400 con 0x7fd20815ee60 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd20806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd20806da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40780/0 (socket says 172.21.15.112:40780) 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 -- 172.21.15.112:0/1913955467 learned_addr learned my addr 172.21.15.112:0/1913955467 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20c851640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd208160380 0x7fd2080aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd207fff640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2080b1030 0x7fd208166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 -- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd208160380 msgr2=0x7fd2080aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd208160380 0x7fd2080aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 -- 172.21.15.112:0/1913955467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2080b1030 msgr2=0x7fd208166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2080b1030 0x7fd208166380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 -- 172.21.15.112:0/1913955467 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2081668c0 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd1fffff640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd20806da60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c940 tx=0x7fd1f000ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0004220 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1f00079b0 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00044b0 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2081f7cd0 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2081fbdb0 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd1f00053b0 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd1f0003c70 con 0x7fd20815ee60 2024-09-10T11:47:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.087+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2080cefa0 con 0x7fd20815ee60 2024-09-10T11:47:05.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.091+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd2081668c0 con 0x7fd20815ee60 2024-09-10T11:47:05.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.163+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "052b01fd-4b1c-44da-a1e1-ebd67f9a8e41", "id": 3} v 0) -- 0x7fd2080cf1f0 con 0x7fd20815ee60 2024-09-10T11:47:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd2057fa640 1 -- 172.21.15.112:0/1913955467 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "052b01fd-4b1c-44da-a1e1-ebd67f9a8e41", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd1f0014030 con 0x7fd20815ee60 2024-09-10T11:47:05.168 INFO:teuthology.orchestra.run.smithi112.stdout:3 2024-09-10T11:47:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 msgr2=0x7fd20806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd20806da60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c940 tx=0x7fd1f000ce00 comp rx=0 tx=0).stop 2024-09-10T11:47:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 shutdown_connections 2024-09-10T11:47:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd208160380 0x7fd2080aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd20815ee60 0x7fd20806da60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 --2- 172.21.15.112:0/1913955467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2080b1030 0x7fd208166380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 >> 172.21.15.112:0/1913955467 conn(0x7fd20809aa60 msgr2=0x7fd2080719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 shutdown_connections 2024-09-10T11:47:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.167+0000 7fd20d052640 1 -- 172.21.15.112:0/1913955467 wait complete. 2024-09-10T11:47:05.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new e8246bdc-d4a1-4679-9723-19881cd49d45 4 2024-09-10T11:47:05.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 -- 172.21.15.112:0/2602930164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 msgr2=0x7fe4100cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 --2- 172.21.15.112:0/2602930164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4100cdca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe400009900 tx=0x7fe40001f0d0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 -- 172.21.15.112:0/2602930164 shutdown_connections 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 --2- 172.21.15.112:0/2602930164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4100746f0 0x7fe410072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 --2- 172.21.15.112:0/2602930164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4100cdca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 -- 172.21.15.112:0/2602930164 >> 172.21.15.112:0/2602930164 conn(0x7fe4100d00d0 msgr2=0x7fe4100d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 -- 172.21.15.112:0/2602930164 shutdown_connections 2024-09-10T11:47:05.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.307+0000 7fe41692a640 1 -- 172.21.15.112:0/2602930164 wait complete. 2024-09-10T11:47:05.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 Processor -- start 2024-09-10T11:47:05.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- start start 2024-09-10T11:47:05.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4101d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4100700d0 0x7fe4101f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4100746f0 0x7fe4100afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4100cea70 con 0x7fe4100700d0 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe4100ce8f0 con 0x7fe41006fcf0 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe4100733c0 con 0x7fe4100746f0 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4101d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4101d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55464/0 (socket says 172.21.15.112:55464) 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe414ec7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4100746f0 0x7fe4100afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 -- 172.21.15.112:0/113350323 learned_addr learned my addr 172.21.15.112:0/113350323 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 -- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4100746f0 msgr2=0x7fe4100afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4100746f0 0x7fe4100afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 -- 172.21.15.112:0/113350323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4100700d0 msgr2=0x7fe4101f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4100700d0 0x7fe4101f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 -- 172.21.15.112:0/113350323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4101f2780 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40ffff640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4101d2bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4000b3040 tx=0x7fe4000a8c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4000b5040 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4000053e0 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4101f2a60 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4000046d0 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4101e23b0 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4000c1060 con 0x7fe41006fcf0 2024-09-10T11:47:05.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe400004c00 con 0x7fe41006fcf0 2024-09-10T11:47:05.315 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T11:47:05.315 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T11:47:05.315 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2024-09-10T11:47:05.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.311+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe410072e80 con 0x7fe41006fcf0 2024-09-10T11:47:05.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.315+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe400018c30 con 0x7fe41006fcf0 2024-09-10T11:47:05.334 INFO:tasks.ceph.mgr.x.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T11:47:05.334 INFO:tasks.ceph.mgr.x.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T11:47:05.334 INFO:tasks.ceph.mgr.x.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-09-10T11:47:05.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.387+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e8246bdc-d4a1-4679-9723-19881cd49d45", "id": 4} v 0) -- 0x7fe410070920 con 0x7fe41006fcf0 2024-09-10T11:47:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe40cff9640 1 -- 172.21.15.112:0/113350323 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8246bdc-d4a1-4679-9723-19881cd49d45", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe400003680 con 0x7fe41006fcf0 2024-09-10T11:47:05.392 INFO:teuthology.orchestra.run.smithi112.stdout:4 2024-09-10T11:47:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 msgr2=0x7fe4101d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4101d2bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4000b3040 tx=0x7fe4000a8c60 comp rx=0 tx=0).stop 2024-09-10T11:47:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 shutdown_connections 2024-09-10T11:47:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4100746f0 0x7fe4100afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4100700d0 0x7fe4101f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 --2- 172.21.15.112:0/113350323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe41006fcf0 0x7fe4101d2bd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 >> 172.21.15.112:0/113350323 conn(0x7fe4100d00d0 msgr2=0x7fe4100b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 shutdown_connections 2024-09-10T11:47:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.391+0000 7fe41692a640 1 -- 172.21.15.112:0/113350323 wait complete. 2024-09-10T11:47:05.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new bf28b344-3556-4cac-b45b-78a56c1f6a9b 5 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- 172.21.15.112:0/1374882473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80af160 msgr2=0x7f1dd80749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- 172.21.15.112:0/1374882473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80af160 0x7f1dd80749f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8076020 tx=0x7f1dd401c8c0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- 172.21.15.112:0/1374882473 shutdown_connections 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- 172.21.15.112:0/1374882473 >> v2:172.21.15.78:3300/0 conn(0x7f1dd80cbe70 0x7f1dd80cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- 172.21.15.112:0/1374882473 >> v2:172.21.15.112:3300/0 conn(0x7f1dd80af540 0x7f1dd80686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- 172.21.15.112:0/1374882473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80af160 0x7f1dd80749f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- 172.21.15.112:0/1374882473 >> 172.21.15.112:0/1374882473 conn(0x7f1dd80d00d0 msgr2=0x7f1dd80d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- 172.21.15.112:0/1374882473 shutdown_connections 2024-09-10T11:47:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- 172.21.15.112:0/1374882473 wait complete. 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 Processor -- start 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- start start 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd80af160 0x7f1dd80ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 0x7f1dd814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 0x7f1dd8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd806eb00 con 0x7f1dd80af160 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd806e980 con 0x7f1dd80af540 2024-09-10T11:47:05.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1de03b5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd806ec80 con 0x7f1dd80cbe70 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1ddd950640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 0x7f1dd814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1dde952640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 0x7f1dd8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1dde952640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 0x7f1dd8158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:44264/0 (socket says 172.21.15.112:44264) 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1dde952640 1 -- 172.21.15.112:0/3672235516 learned_addr learned my addr 172.21.15.112:0/3672235516 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.523+0000 7f1ddd950640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 0x7f1dd814d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49476/0 (socket says 172.21.15.112:49476) 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde151640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd80af160 0x7f1dd80ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde952640 1 -- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 msgr2=0x7f1dd814d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde952640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 0x7f1dd814d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde952640 1 -- 172.21.15.112:0/3672235516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd80af160 msgr2=0x7f1dd80ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde952640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd80af160 0x7f1dd80ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde952640 1 -- 172.21.15.112:0/3672235516 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd80ad010 con 0x7f1dd80cbe70 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1ddd950640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 0x7f1dd814d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dde952640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 0x7f1dd8158b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000cd10 tx=0x7f1dd000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000f450 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd000f700 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd81570b0 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000fb50 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd814d620 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1dd000fcf0 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f1dd0021a60 con 0x7f1dd80cbe70 2024-09-10T11:47:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd80686c0 con 0x7f1dd80cbe70 2024-09-10T11:47:05.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.527+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1dd0014030 con 0x7f1dd80cbe70 2024-09-10T11:47:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.595+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bf28b344-3556-4cac-b45b-78a56c1f6a9b", "id": 5} v 0) -- 0x7f1dd80cb8a0 con 0x7f1dd80cbe70 2024-09-10T11:47:05.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1dceffd640 1 -- 172.21.15.112:0/3672235516 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf28b344-3556-4cac-b45b-78a56c1f6a9b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f1dd0021d80 con 0x7f1dd80cbe70 2024-09-10T11:47:05.600 INFO:teuthology.orchestra.run.smithi112.stdout:5 2024-09-10T11:47:05.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 msgr2=0x7f1dd8158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 0x7f1dd8158b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000cd10 tx=0x7f1dd000a620 comp rx=0 tx=0).stop 2024-09-10T11:47:05.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 shutdown_connections 2024-09-10T11:47:05.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dd80af540 0x7f1dd814d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dd80cbe70 0x7f1dd8158b80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 --2- 172.21.15.112:0/3672235516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd80af160 0x7f1dd80ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 >> 172.21.15.112:0/3672235516 conn(0x7f1dd80d00d0 msgr2=0x7f1dd80d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 shutdown_connections 2024-09-10T11:47:05.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.599+0000 7f1de03b5640 1 -- 172.21.15.112:0/3672235516 wait complete. 2024-09-10T11:47:05.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new a62440b3-86a4-4dba-986f-dfcbd1cf5571 6 2024-09-10T11:47:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.739+0000 7fc75acfe640 1 -- 172.21.15.112:0/352554076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 msgr2=0x7fc7540cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.739+0000 7fc75acfe640 1 --2- 172.21.15.112:0/352554076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 0x7fc7540cca10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7540cd950 tx=0x7fc74801c8c0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- 172.21.15.112:0/352554076 shutdown_connections 2024-09-10T11:47:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 --2- 172.21.15.112:0/352554076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540ccf50 0x7fc75415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 --2- 172.21.15.112:0/352554076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 0x7fc7540cca10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 --2- 172.21.15.112:0/352554076 >> v2:172.21.15.78:3300/0 conn(0x7fc7540af580 0x7fc7540cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- 172.21.15.112:0/352554076 >> 172.21.15.112:0/352554076 conn(0x7fc7540b1c70 msgr2=0x7fc7540b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- 172.21.15.112:0/352554076 shutdown_connections 2024-09-10T11:47:05.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- 172.21.15.112:0/352554076 wait complete. 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 Processor -- start 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- start start 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 0x7fc7540b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 0x7fc7541f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7540ccf50 0x7fc7540c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415ad30 con 0x7fc7540ccf50 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415abb0 con 0x7fc75406f3b0 2024-09-10T11:47:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc75415aeb0 con 0x7fc7540af580 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 0x7fc7541f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc758a9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 0x7fc7540b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 0x7fc7541f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:44286/0 (socket says 172.21.15.112:44286) 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 -- 172.21.15.112:0/1355274804 learned_addr learned my addr 172.21.15.112:0/1355274804 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75929b640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7540ccf50 0x7fc7540c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 -- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 msgr2=0x7fc7540b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 0x7fc7540b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 -- 172.21.15.112:0/1355274804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7540ccf50 msgr2=0x7fc7540c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7540ccf50 0x7fc7540c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 -- 172.21.15.112:0/1355274804 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7540c9630 con 0x7fc7540af580 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc753fff640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 0x7fc7541f7c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc74801af70 tx=0x7fc7480a57f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7480b2040 con 0x7fc7540af580 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc748005030 con 0x7fc7540af580 2024-09-10T11:47:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7540c9910 con 0x7fc7540af580 2024-09-10T11:47:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748005480 con 0x7fc7540af580 2024-09-10T11:47:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7540c9ed0 con 0x7fc7540af580 2024-09-10T11:47:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc748004a60 con 0x7fc7540af580 2024-09-10T11:47:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.743+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc748003bf0 con 0x7fc7540af580 2024-09-10T11:47:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.747+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7540cdd10 con 0x7fc7540af580 2024-09-10T11:47:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.747+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc7480bc060 con 0x7fc7540af580 2024-09-10T11:47:05.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.819+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a62440b3-86a4-4dba-986f-dfcbd1cf5571", "id": 6} v 0) -- 0x7fc7540701a0 con 0x7fc7540af580 2024-09-10T11:47:05.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.823+0000 7fc7517fa640 1 -- 172.21.15.112:0/1355274804 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a62440b3-86a4-4dba-986f-dfcbd1cf5571", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc7480164b0 con 0x7fc7540af580 2024-09-10T11:47:05.825 INFO:teuthology.orchestra.run.smithi112.stdout:6 2024-09-10T11:47:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 msgr2=0x7fc7541f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 0x7fc7541f7c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc74801af70 tx=0x7fc7480a57f0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 shutdown_connections 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7540ccf50 0x7fc7540c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7540af580 0x7fc7541f7c40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 --2- 172.21.15.112:0/1355274804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc75406f3b0 0x7fc7540b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 >> 172.21.15.112:0/1355274804 conn(0x7fc7540b1c70 msgr2=0x7fc7540737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 shutdown_connections 2024-09-10T11:47:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.827+0000 7fc75acfe640 1 -- 172.21.15.112:0/1355274804 wait complete. 2024-09-10T11:47:05.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 4af06387-5a4e-49ac-8e62-c912908852f0 7 2024-09-10T11:47:05.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- 172.21.15.112:0/1869715415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d640d02e0 msgr2=0x7f0d640aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 --2- 172.21.15.112:0/1869715415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d640d02e0 0x7f0d640aed40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009bc0 tx=0x7f0d5c01cb70 comp rx=0 tx=0).stop 2024-09-10T11:47:05.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- 172.21.15.112:0/1869715415 shutdown_connections 2024-09-10T11:47:05.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 --2- 172.21.15.112:0/1869715415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d640d02e0 0x7f0d640aed40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 --2- 172.21.15.112:0/1869715415 >> v2:172.21.15.78:3300/0 conn(0x7f0d6415b980 0x7f0d640b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- 172.21.15.112:0/1869715415 >> 172.21.15.112:0/1869715415 conn(0x7f0d6409aa60 msgr2=0x7f0d6409ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:05.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- 172.21.15.112:0/1869715415 shutdown_connections 2024-09-10T11:47:05.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- 172.21.15.112:0/1869715415 wait complete. 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 Processor -- start 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- start start 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 0x7f0d6406f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d640d02e0 0x7f0d64155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d6415b980 0x7f0d640ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64168880 con 0x7f0d640d02e0 2024-09-10T11:47:05.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64168700 con 0x7f0d640b1f60 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d68c78640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0d64168a00 con 0x7f0d6415b980 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d6259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 0x7f0d6406f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d62d9d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d6415b980 0x7f0d640ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d6259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 0x7f0d6406f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49510/0 (socket says 172.21.15.112:49510) 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.959+0000 7f0d6259c640 1 -- 172.21.15.112:0/17270161 learned_addr learned my addr 172.21.15.112:0/17270161 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d61d9b640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d640d02e0 0x7f0d64155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d6259c640 1 -- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d6415b980 msgr2=0x7f0d640ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d6259c640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d6415b980 0x7f0d640ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d6259c640 1 -- 172.21.15.112:0/17270161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d640d02e0 msgr2=0x7f0d64155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d6259c640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d640d02e0 0x7f0d64155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d6259c640 1 -- 172.21.15.112:0/17270161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6406f040 con 0x7f0d640b1f60 2024-09-10T11:47:05.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d6259c640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 0x7f0d6406f6c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400d720 tx=0x7f0d5400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54017070 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d54009d20 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d641fa4e0 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54005280 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641faaa0 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d54005420 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f0d54010cf0 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d640aed40 con 0x7f0d640b1f60 2024-09-10T11:47:05.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:05.963+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0d54010690 con 0x7f0d640b1f60 2024-09-10T11:47:06.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.035+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4af06387-5a4e-49ac-8e62-c912908852f0", "id": 7} v 0) -- 0x7f0d6406ed20 con 0x7f0d640b1f60 2024-09-10T11:47:06.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.039+0000 7f0d52ffd640 1 -- 172.21.15.112:0/17270161 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4af06387-5a4e-49ac-8e62-c912908852f0", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f0d54010870 con 0x7f0d640b1f60 2024-09-10T11:47:06.041 INFO:teuthology.orchestra.run.smithi112.stdout:7 2024-09-10T11:47:06.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 msgr2=0x7f0d6406f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:06.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 0x7f0d6406f6c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400d720 tx=0x7f0d5400dbe0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 shutdown_connections 2024-09-10T11:47:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d6415b980 0x7f0d640ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d640d02e0 0x7f0d64155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 --2- 172.21.15.112:0/17270161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640b1f60 0x7f0d6406f6c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 >> 172.21.15.112:0/17270161 conn(0x7f0d6409aa60 msgr2=0x7f0d640cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 shutdown_connections 2024-09-10T11:47:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T11:47:06.043+0000 7f0d68c78640 1 -- 172.21.15.112:0/17270161 wait complete. 2024-09-10T11:47:06.057 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T11:47:06.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T11:47:06.060 INFO:tasks.ceph.osd.0:Started 2024-09-10T11:47:06.060 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T11:47:06.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T11:47:06.063 INFO:tasks.ceph.osd.1:Started 2024-09-10T11:47:06.063 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T11:47:06.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T11:47:06.066 INFO:tasks.ceph.osd.2:Started 2024-09-10T11:47:06.066 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T11:47:06.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T11:47:06.068 INFO:tasks.ceph.osd.3:Started 2024-09-10T11:47:06.068 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T11:47:06.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T11:47:06.070 INFO:tasks.ceph.osd.4:Started 2024-09-10T11:47:06.070 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T11:47:06.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T11:47:06.072 INFO:tasks.ceph.osd.5:Started 2024-09-10T11:47:06.072 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T11:47:06.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T11:47:06.074 INFO:tasks.ceph.osd.6:Started 2024-09-10T11:47:06.075 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T11:47:06.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T11:47:06.076 INFO:tasks.ceph.osd.7:Started 2024-09-10T11:47:06.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- 172.21.15.78:0/2914477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ce130 msgr2=0x7f5fac0ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/2914477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ce130 0x7f5fac0ce5e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009c80 tx=0x7f5f9c01cd60 comp rx=0 tx=0).stop 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- 172.21.15.78:0/2914477747 shutdown_connections 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/2914477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ce130 0x7f5fac0ce5e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/2914477747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fac0cfb00 0x7f5fac0cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/2914477747 >> v2:172.21.15.112:3300/0 conn(0x7f5fac15bcf0 0x7f5fac0cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- 172.21.15.78:0/2914477747 >> 172.21.15.78:0/2914477747 conn(0x7f5fac0d19f0 msgr2=0x7f5fac0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- 172.21.15.78:0/2914477747 shutdown_connections 2024-09-10T11:47:06.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- 172.21.15.78:0/2914477747 wait complete. 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 Processor -- start 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- start start 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fac0ce130 0x7f5fac152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 0x7f5fac151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fac15b330 0x7f5fac0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac071060 con 0x7f5fac0cfb00 2024-09-10T11:47:06.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac070ee0 con 0x7f5fac0ce130 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb3b52640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5fac0711e0 con 0x7f5fac15b330 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 0x7f5fac151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 0x7f5fac151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44394/0 (socket says 172.21.15.78:44394) 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 -- 172.21.15.78:0/3834060549 learned_addr learned my addr 172.21.15.78:0/3834060549 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb20ef640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fac15b330 0x7f5fac0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb18ee640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fac0ce130 0x7f5fac152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 -- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fac15b330 msgr2=0x7f5fac0b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fac15b330 0x7f5fac0b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 -- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fac0ce130 msgr2=0x7f5fac152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fac0ce130 0x7f5fac152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.203+0000 7f5fb10ed640 1 -- 172.21.15.78:0/3834060549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac0b6a40 con 0x7f5fac0cfb00 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5fb18ee640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fac0ce130 0x7f5fac152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:06.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5fb10ed640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 0x7f5fac151e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000e9c0 tx=0x7f5fa000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000cd80 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fa0004030 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac0b6d20 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0004480 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac152540 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5fa0003990 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5fa0010b00 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac0cff40 con 0x7f5fac0cfb00 2024-09-10T11:47:06.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.207+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5fa0038860 con 0x7f5fac0cfb00 2024-09-10T11:47:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.267+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fac0c8390 con 0x7f5fac0cfb00 2024-09-10T11:47:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5faa7fc640 1 -- 172.21.15.78:0/3834060549 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5fa0026020 con 0x7f5fac0cfb00 2024-09-10T11:47:06.275 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:06.275 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:06.038566+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:06.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 msgr2=0x7f5fac151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 0x7f5fac151e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000e9c0 tx=0x7f5fa000ee80 comp rx=0 tx=0).stop 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 shutdown_connections 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fac15b330 0x7f5fac0b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0cfb00 0x7f5fac151e90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 --2- 172.21.15.78:0/3834060549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fac0ce130 0x7f5fac152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 >> 172.21.15.78:0/3834060549 conn(0x7f5fac0d19f0 msgr2=0x7f5fac0c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 shutdown_connections 2024-09-10T11:47:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:06.271+0000 7f5fb3b52640 1 -- 172.21.15.78:0/3834060549 wait complete. 2024-09-10T11:47:06.291 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T11:47:06.291 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T11:47:06.776 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:06.775+0000 7faf92daf180 -1 mgr[py] Module not found: 'volumes' 2024-09-10T11:47:06.776 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:06.775+0000 7faf92daf180 -1 mgr[py] Traceback (most recent call last): 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: from .module import Module 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: from .fs.volume import VolumeClient 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr:ModuleNotFoundError: No module named 'ceph.fs' 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr: 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:06.775+0000 7faf92daf180 -1 mgr[py] Class not found in module 'volumes' 2024-09-10T11:47:06.777 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:06.775+0000 7faf92daf180 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-10T11:47:06.824 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-10T11:47:06.819+0000 7f1012ce9180 -1 mgr[py] Module not found: 'volumes' 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-10T11:47:06.819+0000 7f1012ce9180 -1 mgr[py] Traceback (most recent call last): 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr: from .module import Module 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr: from .fs.volume import VolumeClient 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-10T11:47:06.825 INFO:tasks.ceph.mgr.y.smithi078.stderr:ModuleNotFoundError: No module named 'ceph.fs' 2024-09-10T11:47:06.826 INFO:tasks.ceph.mgr.y.smithi078.stderr: 2024-09-10T11:47:06.826 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-10T11:47:06.819+0000 7f1012ce9180 -1 mgr[py] Class not found in module 'volumes' 2024-09-10T11:47:06.826 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-10T11:47:06.819+0000 7f1012ce9180 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-10T11:47:07.097 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:07.204 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:07.203+0000 7faf92daf180 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-10T11:47:07.215 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- 172.21.15.78:0/3663053136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 msgr2=0x7f95a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 --2- 172.21.15.78:0/3663053136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95a80051d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009b60 tx=0x7f95b801d270 comp rx=0 tx=0).stop 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c2423640 1 -- 172.21.15.78:0/3663053136 reap_dead start 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- 172.21.15.78:0/3663053136 shutdown_connections 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- 172.21.15.78:0/3663053136 >> 172.21.15.78:0/3663053136 conn(0x7f95bc0b2530 msgr2=0x7f95bc0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- 172.21.15.78:0/3663053136 shutdown_connections 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- 172.21.15.78:0/3663053136 wait complete. 2024-09-10T11:47:07.216 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 Processor -- start 2024-09-10T11:47:07.217 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- start start 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95bc15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95bc14c1c0 0x7f95bc148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95bc149720 0x7f95bc1f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc06cb00 con 0x7f95a8004d50 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc06c980 con 0x7f95bc14c1c0 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc06cc80 con 0x7f95bc149720 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95bc15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95bc15e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44408/0 (socket says 172.21.15.78:44408) 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 -- 172.21.15.78:0/1670722737 learned_addr learned my addr 172.21.15.78:0/1670722737 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:07.219 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1421640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95bc14c1c0 0x7f95bc148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c2423640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95bc149720 0x7f95bc1f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 -- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95bc149720 msgr2=0x7f95bc1f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95bc149720 0x7f95bc1f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 -- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95bc14c1c0 msgr2=0x7f95bc148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95bc14c1c0 0x7f95bc148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 -- 172.21.15.78:0/1670722737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc149430 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c1c22640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95bc15e8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001900 tx=0x7f95b4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4015070 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95b400eb50 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc15ef00 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.211+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4011460 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.215+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc0adc00 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.215+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95b4018070 con 0x7f95a8004d50 2024-09-10T11:47:07.220 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.215+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f95b401ac10 con 0x7f95a8004d50 2024-09-10T11:47:07.221 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.215+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc0afe20 con 0x7f95a8004d50 2024-09-10T11:47:07.221 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.215+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f95b401a540 con 0x7f95a8004d50 2024-09-10T11:47:07.228 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.223+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 2) ==== 46974+0+0 (secure 0 0 0) 0x7f95b401a720 con 0x7f95a8004d50 2024-09-10T11:47:07.231 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-10T11:47:07.231+0000 7fc94fcf37c0 -1 Falling back to public interface 2024-09-10T11:47:07.257 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-10T11:47:07.251+0000 7f1012ce9180 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-10T11:47:07.287 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95bc069380 con 0x7f95a8004d50 2024-09-10T11:47:07.289 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95b27fc640 1 -- 172.21.15.78:0/1670722737 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f95b400be40 con 0x7f95a8004d50 2024-09-10T11:47:07.289 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-10T11:47:07.289 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:06.038566+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 msgr2=0x7f95bc15e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95bc15e8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001900 tx=0x7f95b4001dc0 comp rx=0 tx=0).stop 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 shutdown_connections 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95bc14c1c0 0x7f95bc148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95bc149720 0x7f95bc1f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 --2- 172.21.15.78:0/1670722737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95a8004d50 0x7f95bc15e8e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 >> 172.21.15.78:0/1670722737 conn(0x7f95bc0b2530 msgr2=0x7f95bc06f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:07.290 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 shutdown_connections 2024-09-10T11:47:07.291 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:07.283+0000 7f95c3e86640 1 -- 172.21.15.78:0/1670722737 wait complete. 2024-09-10T11:47:07.303 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T11:47:07.448 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-10T11:47:07.443+0000 7f1f00b677c0 -1 Falling back to public interface 2024-09-10T11:47:07.459 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-10T11:47:07.455+0000 7fce518147c0 -1 Falling back to public interface 2024-09-10T11:47:07.463 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-10T11:47:07.463+0000 7f449ce2b7c0 -1 Falling back to public interface 2024-09-10T11:47:07.660 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-10T11:47:07.659+0000 7fa045c7f7c0 -1 Falling back to public interface 2024-09-10T11:47:07.704 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-10T11:47:07.699+0000 7f4c836f57c0 -1 Falling back to public interface 2024-09-10T11:47:07.723 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-10T11:47:07.723+0000 7f5be11af7c0 -1 Falling back to public interface 2024-09-10T11:47:07.916 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-10T11:47:07.911+0000 7f50fdfd27c0 -1 Falling back to public interface 2024-09-10T11:47:08.251 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:08.251+0000 7faf38f68640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T11:47:08.428 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-10T11:47:08.251+0000 7faf38f68640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T11:47:11.157 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-10T11:47:11.155+0000 7fc94fcf37c0 -1 osd.6 0 log_to_monitors true 2024-09-10T11:47:11.449 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-10T11:47:11.447+0000 7f449ce2b7c0 -1 osd.7 0 log_to_monitors true 2024-09-10T11:47:11.471 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-10T11:47:11.467+0000 7f1f00b677c0 -1 osd.1 0 log_to_monitors true 2024-09-10T11:47:11.684 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-10T11:47:11.683+0000 7f5be11af7c0 -1 osd.4 0 log_to_monitors true 2024-09-10T11:47:11.792 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-10T11:47:11.787+0000 7f4c836f57c0 -1 osd.2 0 log_to_monitors true 2024-09-10T11:47:11.867 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-10T11:47:11.863+0000 7fce518147c0 -1 osd.3 0 log_to_monitors true 2024-09-10T11:47:12.117 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-10T11:47:12.115+0000 7fa045c7f7c0 -1 osd.5 0 log_to_monitors true 2024-09-10T11:47:12.303 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-10T11:47:12.299+0000 7f50fdfd27c0 -1 osd.0 0 log_to_monitors true 2024-09-10T11:47:13.337 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-10T11:47:13.334+0000 7fc94c4ae640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T11:47:13.356 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-10T11:47:13.354+0000 7fc943ace640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:14.110 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:14.261 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 -- 172.21.15.78:0/1715291385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 msgr2=0x7f78c00cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 --2- 172.21.15.78:0/1715291385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c00cf920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009900 tx=0x7f78b001c8e0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 -- 172.21.15.78:0/1715291385 shutdown_connections 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 --2- 172.21.15.78:0/1715291385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c00ce8a0 0x7f78c00af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 --2- 172.21.15.78:0/1715291385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c00cf920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 -- 172.21.15.78:0/1715291385 >> 172.21.15.78:0/1715291385 conn(0x7f78c00ccc60 msgr2=0x7f78c00cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 -- 172.21.15.78:0/1715291385 shutdown_connections 2024-09-10T11:47:14.262 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.255+0000 7f78c570a640 1 -- 172.21.15.78:0/1715291385 wait complete. 2024-09-10T11:47:14.263 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 Processor -- start 2024-09-10T11:47:14.263 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 -- start start 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c00b1c60 0x7f78c0155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c00ce8a0 0x7f78c01f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c01f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0168dc0 con 0x7f78c015b930 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0168c40 con 0x7f78c00b1c60 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f78c0168f40 con 0x7f78c00ce8a0 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c01f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c01f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47672/0 (socket says 172.21.15.78:47672) 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 -- 172.21.15.78:0/91945110 learned_addr learned my addr 172.21.15.78:0/91945110 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78beffd640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c00b1c60 0x7f78c0155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78be7fc640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c00ce8a0 0x7f78c01f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:14.266 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 -- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c00ce8a0 msgr2=0x7f78c01f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c00ce8a0 0x7f78c01f8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 -- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c00b1c60 msgr2=0x7f78c0155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c00b1c60 0x7f78c0155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 -- 172.21.15.78:0/91945110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c00ad980 con 0x7f78c015b930 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78bf7fe640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c01f9080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c7a0 tx=0x7f78b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003b80 con 0x7f78c015b930 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c00adc60 con 0x7f78c015b930 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b8003d40 con 0x7f78c015b930 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b800aab0 con 0x7f78c015b930 2024-09-10T11:47:14.267 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.259+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c00b3220 con 0x7f78c015b930 2024-09-10T11:47:14.268 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.263+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c00b3010 con 0x7f78c015b930 2024-09-10T11:47:14.268 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.263+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) ==== 93765+0+0 (secure 0 0 0) 0x7f78b800ac50 con 0x7f78c015b930 2024-09-10T11:47:14.268 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.263+0000 7f78a77fe640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f78ac06f680 0x7f78ac071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:14.268 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.263+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f78b808e700 con 0x7f78c015b930 2024-09-10T11:47:14.268 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.263+0000 7f78beffd640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f78ac06f680 0x7f78ac071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:14.269 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.263+0000 7f78beffd640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f78ac06f680 0x7f78ac071b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f78b00af000 tx=0x7f78b001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:14.273 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.267+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f78b805be10 con 0x7f78c015b930 2024-09-10T11:47:14.461 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.455+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78c00af550 con 0x7f78c015b930 2024-09-10T11:47:14.462 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78a77fe640 1 -- 172.21.15.78:0/91945110 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7f78b80605d0 con 0x7f78c015b930 2024-09-10T11:47:14.462 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-10T11:47:14.462 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":13,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:13.391385+0000","last_up_change":"2024-09-10T11:47:13.391385+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:14.465 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f78ac06f680 msgr2=0x7f78ac071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:14.465 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f78ac06f680 0x7f78ac071b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f78b00af000 tx=0x7f78b001b120 comp rx=0 tx=0).stop 2024-09-10T11:47:14.465 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 msgr2=0x7f78c01f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:14.465 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c01f9080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c7a0 tx=0x7f78b800cc60 comp rx=0 tx=0).stop 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 shutdown_connections 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f78ac06f680 0x7f78ac071b40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78c015b930 0x7f78c01f9080 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c00ce8a0 0x7f78c01f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 --2- 172.21.15.78:0/91945110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c00b1c60 0x7f78c0155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 >> 172.21.15.78:0/91945110 conn(0x7f78c00ccc60 msgr2=0x7f78c00cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 shutdown_connections 2024-09-10T11:47:14.466 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:14.459+0000 7f78c570a640 1 -- 172.21.15.78:0/91945110 wait complete. 2024-09-10T11:47:14.486 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T11:47:15.143 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-10T11:47:15.142+0000 7fa041c28640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T11:47:15.167 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-10T11:47:15.166+0000 7fa039a5a640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:15.169 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-10T11:47:15.166+0000 7f4498dd4640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T11:47:15.192 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-10T11:47:15.190+0000 7f5bdd96a640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T11:47:15.203 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-10T11:47:15.202+0000 7f4490c06640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:15.211 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-10T11:47:15.210+0000 7f5bd4f8a640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:15.559 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-10T11:47:15.559+0000 7f1efd322640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T11:47:15.569 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-10T11:47:15.567+0000 7f4c7f69e640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T11:47:15.569 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-10T11:47:15.567+0000 7f50fa78d640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T11:47:15.599 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-10T11:47:15.599+0000 7f50f1dad640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:15.600 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-10T11:47:15.599+0000 7f4c774d0640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:15.600 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-10T11:47:15.599+0000 7f1ef4942640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:15.647 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-10T11:47:15.647+0000 7fce4d7bd640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T11:47:15.671 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-10T11:47:15.671+0000 7fce455ef640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:47:19.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:47:19.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:47:21.292 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:21.420 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- 172.21.15.78:0/3045662252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 msgr2=0x7f045c0ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.420 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- 172.21.15.78:0/3045662252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0ca890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f045c073c30 tx=0x7f045001c8c0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.420 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- 172.21.15.78:0/3045662252 shutdown_connections 2024-09-10T11:47:21.420 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- 172.21.15.78:0/3045662252 >> v2:172.21.15.112:3300/0 conn(0x7f045c074070 0x7f045c0744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.420 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- 172.21.15.78:0/3045662252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0ca890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.420 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- 172.21.15.78:0/3045662252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c1610d0 0x7f045c161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.421 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- 172.21.15.78:0/3045662252 >> 172.21.15.78:0/3045662252 conn(0x7f045c0b1d90 msgr2=0x7f045c0b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:21.421 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- 172.21.15.78:0/3045662252 shutdown_connections 2024-09-10T11:47:21.421 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- 172.21.15.78:0/3045662252 wait complete. 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 Processor -- start 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- start start 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c074070 0x7f045c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f045c1610d0 0x7f045c0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f045c0cf0c0 con 0x7f045c0cbea0 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f045c0cdab0 con 0x7f045c1610d0 2024-09-10T11:47:21.423 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f04627fb640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f045c0cf240 con 0x7f045c074070 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59030/0 (socket says 172.21.15.78:59030) 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 -- 172.21.15.78:0/1950026693 learned_addr learned my addr 172.21.15.78:0/1950026693 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045bfff640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c074070 0x7f045c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 -- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c074070 msgr2=0x7f045c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c074070 0x7f045c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 -- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f045c1610d0 msgr2=0x7f045c0c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f0460d98640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f045c1610d0 0x7f045c0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f045c1610d0 0x7f045c0c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.418+0000 7f045b7fe640 1 -- 172.21.15.78:0/1950026693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c155fe0 con 0x7f045c0cbea0 2024-09-10T11:47:21.424 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f045bfff640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c074070 0x7f045c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:21.425 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f045b7fe640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0c7f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04500b0040 tx=0x7f04500a5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:21.425 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500b2040 con 0x7f045c0cbea0 2024-09-10T11:47:21.425 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04500053e0 con 0x7f045c0cbea0 2024-09-10T11:47:21.425 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045c0c3d50 con 0x7f045c0cbea0 2024-09-10T11:47:21.425 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500046d0 con 0x7f045c0cbea0 2024-09-10T11:47:21.425 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c0b3fd0 con 0x7f045c0cbea0 2024-09-10T11:47:21.426 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c0ca890 con 0x7f045c0cbea0 2024-09-10T11:47:21.426 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f04500be060 con 0x7f045c0cbea0 2024-09-10T11:47:21.426 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f0458ff9640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f044806f700 0x7f0448071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.426 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f0450128e30 con 0x7f045c0cbea0 2024-09-10T11:47:21.426 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f045bfff640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f044806f700 0x7f0448071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.426 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.422+0000 7f045bfff640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f044806f700 0x7f0448071bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f044c005fd0 tx=0x7f044c005dc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:21.429 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.426+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f04500164b0 con 0x7f045c0cbea0 2024-09-10T11:47:21.575 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.574+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f045c0b61c0 con 0x7f045c0cbea0 2024-09-10T11:47:21.577 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.574+0000 7f0458ff9640 1 -- 172.21.15.78:0/1950026693 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12884 (secure 0 0 0) 0x7f04500f6150 con 0x7f045c0cbea0 2024-09-10T11:47:21.577 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-10T11:47:21.577 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":19,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:20.221864+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f044806f700 msgr2=0x7f0448071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f044806f700 0x7f0448071bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f044c005fd0 tx=0x7f044c005dc0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 msgr2=0x7f045c0c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0c7f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04500b0040 tx=0x7f04500a5740 comp rx=0 tx=0).stop 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 shutdown_connections 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f045c1610d0 0x7f045c0c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f044806f700 0x7f0448071bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.579 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f045c0cbea0 0x7f045c0c7f90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.580 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 --2- 172.21.15.78:0/1950026693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f045c074070 0x7f045c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.580 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 >> 172.21.15.78:0/1950026693 conn(0x7f045c0b1d90 msgr2=0x7f045c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:21.580 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 shutdown_connections 2024-09-10T11:47:21.580 INFO:teuthology.misc.health.smithi078.stderr:2024-09-10T11:47:21.578+0000 7f04627fb640 1 -- 172.21.15.78:0/1950026693 wait complete. 2024-09-10T11:47:21.595 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T11:47:21.595 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T11:47:21.595 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T11:47:21.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T11:47:21.598 INFO:tasks.ceph.mds.a:Started 2024-09-10T11:47:21.599 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T11:47:21.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T11:47:21.601 INFO:tasks.ceph.mds.c:Started 2024-09-10T11:47:21.601 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T11:47:21.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T11:47:21.604 INFO:tasks.ceph.mds.b:Started 2024-09-10T11:47:21.604 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T11:47:21.604 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T11:47:21.606 INFO:tasks.ceph.mds.d:Started 2024-09-10T11:47:21.607 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T11:47:21.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T11:47:21.680 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-10T11:47:21.680 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 -- 172.21.15.78:0/505185704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe68003a10 msgr2=0x7fbe68003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/505185704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe68003a10 0x7fbe68003e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400bb40 tx=0x7fbe6401cda0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7d3f1640 1 -- 172.21.15.78:0/505185704 reap_dead start 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 -- 172.21.15.78:0/505185704 shutdown_connections 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 -- 172.21.15.78:0/505185704 >> 172.21.15.78:0/505185704 conn(0x7fbe780d19f0 msgr2=0x7fbe780d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 -- 172.21.15.78:0/505185704 shutdown_connections 2024-09-10T11:47:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 -- 172.21.15.78:0/505185704 wait complete. 2024-09-10T11:47:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 Processor -- start 2024-09-10T11:47:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.722+0000 7fbe7ee54640 1 -- start start 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe68003a10 0x7fbe7815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe78148ef0 0x7fbe78159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 0x7fbe780b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78166810 con 0x7fbe7815a100 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78166690 con 0x7fbe78148ef0 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbe78166990 con 0x7fbe68003a10 2024-09-10T11:47:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 0x7fbe780b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 0x7fbe780b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59082/0 (socket says 172.21.15.78:59082) 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 -- 172.21.15.78:0/130502967 learned_addr learned my addr 172.21.15.78:0/130502967 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe77fff640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe78148ef0 0x7fbe78159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7cbf0640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe68003a10 0x7fbe7815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 -- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe68003a10 msgr2=0x7fbe7815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe68003a10 0x7fbe7815b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 -- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe78148ef0 msgr2=0x7fbe78159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe78148ef0 0x7fbe78159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 -- 172.21.15.78:0/130502967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe78149350 con 0x7fbe7815a100 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7d3f1640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 0x7fbe780b34d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe780d0fa0 tx=0x7fbe7000fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70003b90 con 0x7fbe7815a100 2024-09-10T11:47:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe70003d50 con 0x7fbe7815a100 2024-09-10T11:47:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe781629f0 con 0x7fbe7815a100 2024-09-10T11:47:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000eb00 con 0x7fbe7815a100 2024-09-10T11:47:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe78162fb0 con 0x7fbe7815a100 2024-09-10T11:47:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7815bcf0 con 0x7fbe7815a100 2024-09-10T11:47:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fbe7001b020 con 0x7fbe7815a100 2024-09-10T11:47:21.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe757fa640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbe5c06f740 0x7fbe5c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:21.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fbe7008f550 con 0x7fbe7815a100 2024-09-10T11:47:21.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.726+0000 7fbe7cbf0640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbe5c06f740 0x7fbe5c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:21.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.730+0000 7fbe7cbf0640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbe5c06f740 0x7fbe5c071c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b0000 tx=0x7fbe640a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.730+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fbe7005c7e0 con 0x7fbe7815a100 2024-09-10T11:47:21.766 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-09-10T11:47:21.769 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-09-10T11:47:21.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.902+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe780d00e0 con 0x7fbe7815a100 2024-09-10T11:47:21.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe757fa640 1 -- 172.21.15.78:0/130502967 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fbe7005c0e0 con 0x7fbe7815a100 2024-09-10T11:47:21.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"btime":"2024-09-10T11:47:21:685001+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2317375683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2317375683},{"type":"v1","addr":"172.21.15.78:6835","nonce":2317375683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T11:47:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-09-10T11:47:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbe5c06f740 msgr2=0x7fbe5c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbe5c06f740 0x7fbe5c071c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b0000 tx=0x7fbe640a7040 comp rx=0 tx=0).stop 2024-09-10T11:47:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 msgr2=0x7fbe780b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 0x7fbe780b34d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe780d0fa0 tx=0x7fbe7000fd90 comp rx=0 tx=0).stop 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 shutdown_connections 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe78148ef0 0x7fbe78159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbe5c06f740 0x7fbe5c071c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7815a100 0x7fbe780b34d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 --2- 172.21.15.78:0/130502967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe68003a10 0x7fbe7815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 >> 172.21.15.78:0/130502967 conn(0x7fbe780d19f0 msgr2=0x7fbe780c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 shutdown_connections 2024-09-10T11:47:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:21.906+0000 7fbe7ee54640 1 -- 172.21.15.78:0/130502967 wait complete. 2024-09-10T11:47:23.926 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T11:47:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 -- 172.21.15.78:0/2976866228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cc4003a60 msgr2=0x7f5cc4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 --2- 172.21.15.78:0/2976866228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cc4003a60 0x7f5cc4003e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009b60 tx=0x7f5ccc01d270 comp rx=0 tx=0).stop 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 -- 172.21.15.78:0/2976866228 shutdown_connections 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 --2- 172.21.15.78:0/2976866228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cc4003a60 0x7f5cc4003e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 -- 172.21.15.78:0/2976866228 >> 172.21.15.78:0/2976866228 conn(0x7f5cdc0d0900 msgr2=0x7f5cdc0d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 -- 172.21.15.78:0/2976866228 shutdown_connections 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.062+0000 7f5ce2389640 1 -- 172.21.15.78:0/2976866228 wait complete. 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 Processor -- start 2024-09-10T11:47:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- start start 2024-09-10T11:47:24.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5cc4003a60 0x7f5cdc1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cdc158b10 0x7f5cdc145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 0x7f5cdc148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc15cd40 con 0x7f5cdc1488f0 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc15cbc0 con 0x7f5cdc158b10 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5cdc0730b0 con 0x7f5cc4003a60 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 0x7f5cdc148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 0x7f5cdc148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59096/0 (socket says 172.21.15.78:59096) 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 -- 172.21.15.78:0/3948885183 learned_addr learned my addr 172.21.15.78:0/3948885183 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5cdb7fe640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cdc158b10 0x7f5cdc145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5cdbfff640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5cc4003a60 0x7f5cdc1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 -- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5cc4003a60 msgr2=0x7f5cdc1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5cc4003a60 0x7f5cdc1566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 -- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cdc158b10 msgr2=0x7f5cdc145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cdc158b10 0x7f5cdc145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 -- 172.21.15.78:0/3948885183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc0b37d0 con 0x7f5cdc1488f0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce0926640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 0x7f5cdc148d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0caf00 tx=0x7f5cd400dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4003d90 con 0x7f5cdc1488f0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cd4006160 con 0x7f5cdc1488f0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cdc1590b0 con 0x7f5cdc1488f0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4006590 con 0x7f5cdc1488f0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cdc159670 con 0x7f5cdc1488f0 2024-09-10T11:47:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.066+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cdc073610 con 0x7f5cdc1488f0 2024-09-10T11:47:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.070+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f5cd400b550 con 0x7f5cdc1488f0 2024-09-10T11:47:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.070+0000 7f5cd8ff9640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5cc806f710 0x7f5cc8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.070+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f5cd408f820 con 0x7f5cdc1488f0 2024-09-10T11:47:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.070+0000 7f5cdbfff640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5cc806f710 0x7f5cc8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.070+0000 7f5cdbfff640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5cc806f710 0x7f5cc8071bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0ae000 tx=0x7f5ccc01a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.074+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f5cd405cab0 con 0x7f5cdc1488f0 2024-09-10T11:47:24.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.238+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cdc06d610 con 0x7f5cdc1488f0 2024-09-10T11:47:24.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5cd8ff9640 1 -- 172.21.15.78:0/3948885183 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f5cd405c3b0 con 0x7f5cdc1488f0 2024-09-10T11:47:24.246 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"btime":"2024-09-10T11:47:22:686238+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2177635436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2177635436},{"type":"v1","addr":"172.21.15.112:6835","nonce":2177635436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2893103588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2893103588},{"type":"v1","addr":"172.21.15.112:6837","nonce":2893103588}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1361044038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1361044038},{"type":"v1","addr":"172.21.15.78:6834","nonce":1361044038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2317375683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2317375683},{"type":"v1","addr":"172.21.15.78:6835","nonce":2317375683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5cc806f710 msgr2=0x7f5cc8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5cc806f710 0x7f5cc8071bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0ae000 tx=0x7f5ccc01a010 comp rx=0 tx=0).stop 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 msgr2=0x7f5cdc148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 0x7f5cdc148d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0caf00 tx=0x7f5cd400dad0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 shutdown_connections 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cdc158b10 0x7f5cdc145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5cc806f710 0x7f5cc8071bd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cdc1488f0 0x7f5cdc148d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 --2- 172.21.15.78:0/3948885183 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5cc4003a60 0x7f5cdc1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 >> 172.21.15.78:0/3948885183 conn(0x7f5cdc0d0900 msgr2=0x7f5cdc0d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 shutdown_connections 2024-09-10T11:47:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.242+0000 7f5ce2389640 1 -- 172.21.15.78:0/3948885183 wait complete. 2024-09-10T11:47:24.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T11:47:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- 172.21.15.78:0/2704044835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80caf50 msgr2=0x7f52b80cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/2704044835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80caf50 0x7f52b80cb380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52b8069b10 tx=0x7f52ac01c800 comp rx=0 tx=0).stop 2024-09-10T11:47:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- 172.21.15.78:0/2704044835 shutdown_connections 2024-09-10T11:47:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/2704044835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80caf50 0x7f52b80cb380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/2704044835 >> v2:172.21.15.112:3300/0 conn(0x7f52b815a780 0x7f52b8073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- 172.21.15.78:0/2704044835 >> 172.21.15.78:0/2704044835 conn(0x7f52b80d0900 msgr2=0x7f52b80d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- 172.21.15.78:0/2704044835 shutdown_connections 2024-09-10T11:47:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- 172.21.15.78:0/2704044835 wait complete. 2024-09-10T11:47:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 Processor -- start 2024-09-10T11:47:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- start start 2024-09-10T11:47:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52b80caf50 0x7f52b81f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52b815a780 0x7f52b80ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 0x7f52b80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8167890 con 0x7f52b815ab60 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8167710 con 0x7f52b80caf50 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52bcd4e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f52b8167a10 con 0x7f52b815a780 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 0x7f52b80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 0x7f52b80c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59126/0 (socket says 172.21.15.78:59126) 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b6d9d640 1 -- 172.21.15.78:0/1053884486 learned_addr learned my addr 172.21.15.78:0/1053884486 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b6d9d640 1 -- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52b815a780 msgr2=0x7f52b80ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b5d9b640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52b815a780 0x7f52b80ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b6d9d640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52b815a780 0x7f52b80ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b659c640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52b80caf50 0x7f52b81f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.382+0000 7f52b6d9d640 1 -- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52b80caf50 msgr2=0x7f52b81f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52b6d9d640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52b80caf50 0x7f52b81f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52b6d9d640 1 -- 172.21.15.78:0/1053884486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b80c7df0 con 0x7f52b815ab60 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52b6d9d640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 0x7f52b80c6780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52b000caf0 tx=0x7f52b000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b0016020 con 0x7f52b815ab60 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52b000ab60 con 0x7f52b815ab60 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b80c8090 con 0x7f52b815ab60 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b000ce30 con 0x7f52b815ab60 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b80c8650 con 0x7f52b815ab60 2024-09-10T11:47:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b80cb380 con 0x7f52b815ab60 2024-09-10T11:47:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f52b0019020 con 0x7f52b815ab60 2024-09-10T11:47:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52a6ffd640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f529806f710 0x7f5298071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f52b008f6f0 con 0x7f52b815ab60 2024-09-10T11:47:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52b659c640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f529806f710 0x7f5298071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.386+0000 7f52b659c640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f529806f710 0x7f5298071bd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52b81574e0 tx=0x7f52a80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:24.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.390+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f52b0020020 con 0x7f52b815ab60 2024-09-10T11:47:24.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f52b815a060 con 0x7f52b815ab60 2024-09-10T11:47:24.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52a6ffd640 1 -- 172.21.15.78:0/1053884486 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f52b005c990 con 0x7f52b815ab60 2024-09-10T11:47:24.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:24.540 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-10T11:47:24.540 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-10T11:47:24.540 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-10T11:47:24.540 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-10T11:47:24.540 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-10T11:47:24.540 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f529806f710 msgr2=0x7f5298071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f529806f710 0x7f5298071bd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52b81574e0 tx=0x7f52a80091e0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 msgr2=0x7f52b80c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 0x7f52b80c6780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52b000caf0 tx=0x7f52b000cbe0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 shutdown_connections 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f529806f710 0x7f5298071bd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b815ab60 0x7f52b80c6780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52b815a780 0x7f52b80ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 --2- 172.21.15.78:0/1053884486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52b80caf50 0x7f52b81f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 >> 172.21.15.78:0/1053884486 conn(0x7f52b80d0900 msgr2=0x7f52b81548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 shutdown_connections 2024-09-10T11:47:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.538+0000 7f52bcd4e640 1 -- 172.21.15.78:0/1053884486 wait complete. 2024-09-10T11:47:24.558 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T11:47:24.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T11:47:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/3600204583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f8005920 msgr2=0x7f96f8005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 --2- 172.21.15.78:0/3600204583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f8005920 0x7f96f8005da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006f40 tx=0x7f96f401ce60 comp rx=0 tx=0).stop 2024-09-10T11:47:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970b59e640 1 -- 172.21.15.78:0/3600204583 reap_dead start 2024-09-10T11:47:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/3600204583 shutdown_connections 2024-09-10T11:47:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/3600204583 >> 172.21.15.78:0/3600204583 conn(0x7f970c0b18a0 msgr2=0x7f970c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/3600204583 shutdown_connections 2024-09-10T11:47:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/3600204583 wait complete. 2024-09-10T11:47:24.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 Processor -- start 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- start start 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c13e2f0 0x7f970c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 0x7f970c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c1f6940 0x7f970c1f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f970c15e0d0 con 0x7f970c1f7630 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f970c15df50 con 0x7f970c13e2f0 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f970c15e250 con 0x7f970c1f6940 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 0x7f970c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 0x7f970c156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59140/0 (socket says 172.21.15.78:59140) 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 -- 172.21.15.78:0/4172777798 learned_addr learned my addr 172.21.15.78:0/4172777798 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970b59e640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c1f6940 0x7f970c1f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970ad9d640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c13e2f0 0x7f970c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 -- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c1f6940 msgr2=0x7f970c1f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c1f6940 0x7f970c1f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 -- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c13e2f0 msgr2=0x7f970c14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c13e2f0 0x7f970c14e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 -- 172.21.15.78:0/4172777798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c1551f0 con 0x7f970c1f7630 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f970259c640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 0x7f970c156570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96f4098850 tx=0x7f96f4006c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4001500 con 0x7f970c1f7630 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f40016a0 con 0x7f970c1f7630 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c1554d0 con 0x7f970c1f7630 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4006330 con 0x7f970c1f7630 2024-09-10T11:47:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.682+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c155a90 con 0x7f970c1f7630 2024-09-10T11:47:24.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.686+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970c0b2930 con 0x7f970c1f7630 2024-09-10T11:47:24.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.686+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f96f40036e0 con 0x7f970c1f7630 2024-09-10T11:47:24.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.686+0000 7f9703fff640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f96ec06f740 0x7f96ec071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:24.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.686+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f96f40b4020 con 0x7f970c1f7630 2024-09-10T11:47:24.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.686+0000 7f970ad9d640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f96ec06f740 0x7f96ec071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:24.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.686+0000 7f970ad9d640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f96ec06f740 0x7f96ec071c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0058d0 tx=0x7f96fc005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:24.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.690+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f96f4016c70 con 0x7f970c1f7630 2024-09-10T11:47:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:24.826+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f970c1592b0 con 0x7f970c1f7630 2024-09-10T11:47:25.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.706+0000 7f9703fff640 1 -- 172.21.15.78:0/4172777798 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f96f40f5e10 con 0x7f970c1f7630 2024-09-10T11:47:25.709 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f96ec06f740 msgr2=0x7f96ec071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f96ec06f740 0x7f96ec071c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0058d0 tx=0x7f96fc005860 comp rx=0 tx=0).stop 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 msgr2=0x7f970c156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 0x7f970c156570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96f4098850 tx=0x7f96f4006c20 comp rx=0 tx=0).stop 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 shutdown_connections 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f96ec06f740 0x7f96ec071c00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c1f6940 0x7f970c1f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f970c1f7630 0x7f970c156570 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 --2- 172.21.15.78:0/4172777798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c13e2f0 0x7f970c14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 >> 172.21.15.78:0/4172777798 conn(0x7f970c0b18a0 msgr2=0x7f970c0b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 shutdown_connections 2024-09-10T11:47:25.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.710+0000 7f9711156640 1 -- 172.21.15.78:0/4172777798 wait complete. 2024-09-10T11:47:25.737 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T11:47:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 -- 172.21.15.78:0/688987134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 msgr2=0x7fd53c06d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 --2- 172.21.15.78:0/688987134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c06d280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06da90 tx=0x7fd53401cd80 comp rx=0 tx=0).stop 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 -- 172.21.15.78:0/688987134 shutdown_connections 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 --2- 172.21.15.78:0/688987134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c06d280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 --2- 172.21.15.78:0/688987134 >> v2:172.21.15.112:3300/0 conn(0x7fd53c15ccf0 0x7fd53c15ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 --2- 172.21.15.78:0/688987134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 0x7fd53c0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 -- 172.21.15.78:0/688987134 >> 172.21.15.78:0/688987134 conn(0x7fd53c0b1970 msgr2=0x7fd53c0b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 -- 172.21.15.78:0/688987134 shutdown_connections 2024-09-10T11:47:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.866+0000 7fd541451640 1 -- 172.21.15.78:0/688987134 wait complete. 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 Processor -- start 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- start start 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 0x7fd53c1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53c15ccf0 0x7fd53c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd53c0b29f0 con 0x7fd53c06cdf0 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd53c0b2870 con 0x7fd53c15ccf0 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd53c0b2b70 con 0x7fd53c0aeef0 2024-09-10T11:47:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59152/0 (socket says 172.21.15.78:59152) 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 -- 172.21.15.78:0/1805326378 learned_addr learned my addr 172.21.15.78:0/1805326378 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53b7fe640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53c15ccf0 0x7fd53c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53a7fc640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 0x7fd53c1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 -- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 msgr2=0x7fd53c1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 0x7fd53c1464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 -- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53c15ccf0 msgr2=0x7fd53c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53c15ccf0 0x7fd53c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 -- 172.21.15.78:0/1805326378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53c1f8a20 con 0x7fd53c06cdf0 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53a7fc640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 0x7fd53c1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd53affd640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c154160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c970 tx=0x7fd52c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c007bb0 con 0x7fd53c06cdf0 2024-09-10T11:47:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd52c007e40 con 0x7fd53c06cdf0 2024-09-10T11:47:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53c1f8d00 con 0x7fd53c06cdf0 2024-09-10T11:47:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c005280 con 0x7fd53c06cdf0 2024-09-10T11:47:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd53c154870 con 0x7fd53c06cdf0 2024-09-10T11:47:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.870+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53c0b4550 con 0x7fd53c06cdf0 2024-09-10T11:47:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.874+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd52c005420 con 0x7fd53c06cdf0 2024-09-10T11:47:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.874+0000 7fd5237fe640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd52806f710 0x7fd528071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.874+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fd52c08fb40 con 0x7fd53c06cdf0 2024-09-10T11:47:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.874+0000 7fd53a7fc640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd52806f710 0x7fd528071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.874+0000 7fd53a7fc640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd52806f710 0x7fd528071bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd53c1576c0 tx=0x7fd530005ca0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:25.878+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd52c014030 con 0x7fd53c06cdf0 2024-09-10T11:47:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.022+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd53c0b3ab0 con 0x7fd53c06cdf0 2024-09-10T11:47:26.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.718+0000 7fd5237fe640 1 -- 172.21.15.78:0/1805326378 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fd52c05cc60 con 0x7fd53c06cdf0 2024-09-10T11:47:26.720 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd52806f710 msgr2=0x7fd528071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd52806f710 0x7fd528071bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd53c1576c0 tx=0x7fd530005ca0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 msgr2=0x7fd53c154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c154160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c970 tx=0x7fd52c00ce30 comp rx=0 tx=0).stop 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 shutdown_connections 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53c15ccf0 0x7fd53c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd52806f710 0x7fd528071bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd53c0aeef0 0x7fd53c1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 --2- 172.21.15.78:0/1805326378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c06cdf0 0x7fd53c154160 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 >> 172.21.15.78:0/1805326378 conn(0x7fd53c0b1970 msgr2=0x7fd53c15abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:26.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 shutdown_connections 2024-09-10T11:47:26.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.722+0000 7fd541451640 1 -- 172.21.15.78:0/1805326378 wait complete. 2024-09-10T11:47:26.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T11:47:26.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- 172.21.15.78:0/92263846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 msgr2=0x7fb9dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:26.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/92263846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9dc004c90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c700 tx=0x7fb9e801c6a0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- 172.21.15.78:0/92263846 shutdown_connections 2024-09-10T11:47:26.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/92263846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9dc004c90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- 172.21.15.78:0/92263846 >> 172.21.15.78:0/92263846 conn(0x7fb9f40b1970 msgr2=0x7fb9f40b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:26.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- 172.21.15.78:0/92263846 shutdown_connections 2024-09-10T11:47:26.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- 172.21.15.78:0/92263846 wait complete. 2024-09-10T11:47:26.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 Processor -- start 2024-09-10T11:47:26.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- start start 2024-09-10T11:47:26.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9f4155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:26.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9f4154360 0x7fb9f40ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:26.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f41547e0 0x7fb9f4150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:26.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f406cf70 con 0x7fb9dc004810 2024-09-10T11:47:26.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f406cdf0 con 0x7fb9f41547e0 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f94a1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f406d0f0 con 0x7fb9f4154360 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9f4155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9f4155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59172/0 (socket says 172.21.15.78:59172) 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/3377073277 learned_addr learned my addr 172.21.15.78:0/3377073277 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f27fc640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9f4154360 0x7fb9f40ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f37fe640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f41547e0 0x7fb9f4150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9f4154360 msgr2=0x7fb9f40ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9f4154360 0x7fb9f40ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f41547e0 msgr2=0x7fb9f4150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f41547e0 0x7fb9f4150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.882+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/3377073277 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f4156500 con 0x7fb9dc004810 2024-09-10T11:47:26.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9f2ffd640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9f4155e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4001800 tx=0x7fb9e4001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:26.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4012850 con 0x7fb9dc004810 2024-09-10T11:47:26.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9e4012ae0 con 0x7fb9dc004810 2024-09-10T11:47:26.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f41567e0 con 0x7fb9dc004810 2024-09-10T11:47:26.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e401a400 con 0x7fb9dc004810 2024-09-10T11:47:26.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f41f2500 con 0x7fb9dc004810 2024-09-10T11:47:26.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f4160130 con 0x7fb9dc004810 2024-09-10T11:47:26.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb9e400d030 con 0x7fb9dc004810 2024-09-10T11:47:26.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9db7fe640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:26.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fb9e4092ed0 con 0x7fb9dc004810 2024-09-10T11:47:26.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9f27fc640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:26.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.886+0000 7fb9f27fc640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0057f0 tx=0x7fb9e8019440 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:26.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:26.890+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb9e4029080 con 0x7fb9dc004810 2024-09-10T11:47:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.058+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb9f40b3ab0 con 0x7fb9dc004810 2024-09-10T11:47:27.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.754+0000 7fb9db7fe640 1 -- 172.21.15.78:0/3377073277 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb9e4016030 con 0x7fb9dc004810 2024-09-10T11:47:27.768 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.774+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 msgr2=0x7fb9e0071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0057f0 tx=0x7fb9e8019440 comp rx=0 tx=0).stop 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 msgr2=0x7fb9f4155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9f4155e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4001800 tx=0x7fb9e4001830 comp rx=0 tx=0).stop 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 shutdown_connections 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f41547e0 0x7fb9f4150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9f4154360 0x7fb9f40ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 --2- 172.21.15.78:0/3377073277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc004810 0x7fb9f4155e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 >> 172.21.15.78:0/3377073277 conn(0x7fb9f40b1970 msgr2=0x7fb9f40cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 shutdown_connections 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.778+0000 7fb9f94a1640 1 -- 172.21.15.78:0/3377073277 wait complete. 2024-09-10T11:47:27.803 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/2050170800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 msgr2=0x7f7178071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 --2- 172.21.15.78:0/2050170800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f7178071f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7168009900 tx=0x7f716801c8b0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/2050170800 shutdown_connections 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 --2- 172.21.15.78:0/2050170800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 0x7f717806fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 --2- 172.21.15.78:0/2050170800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f7178071f30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/2050170800 >> 172.21.15.78:0/2050170800 conn(0x7f71780cf7c0 msgr2=0x7f71780cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/2050170800 shutdown_connections 2024-09-10T11:47:27.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/2050170800 wait complete. 2024-09-10T11:47:27.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 Processor -- start 2024-09-10T11:47:27.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- start start 2024-09-10T11:47:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 0x7f71781511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f71780b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f717815e1f0 0x7f71781597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7178167cf0 con 0x7f717815a610 2024-09-10T11:47:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7178167b70 con 0x7f717815e1f0 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7178167e70 con 0x7f717806f870 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f71780b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f71780b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59176/0 (socket says 172.21.15.78:59176) 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 -- 172.21.15.78:0/666524214 learned_addr learned my addr 172.21.15.78:0/666524214 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f7176d9d640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f717815e1f0 0x7f71781597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717659c640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 0x7f71781511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 -- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 msgr2=0x7f71781511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 0x7f71781511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 -- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f717815e1f0 msgr2=0x7f71781597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f717815e1f0 0x7f71781597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 -- 172.21.15.78:0/666524214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7178159d20 con 0x7f717815a610 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717659c640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 0x7f71781511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716dd9b640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f71780b03f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f716000d980 tx=0x7f716000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160017070 con 0x7f717815a610 2024-09-10T11:47:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7160009d60 con 0x7f717815a610 2024-09-10T11:47:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71780af630 con 0x7f717815a610 2024-09-10T11:47:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160005280 con 0x7f717815a610 2024-09-10T11:47:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.922+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71780afbf0 con 0x7f717815a610 2024-09-10T11:47:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.926+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717806fce0 con 0x7f717815a610 2024-09-10T11:47:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.926+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f7160005420 con 0x7f717815a610 2024-09-10T11:47:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.926+0000 7f716f7fe640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f715806f710 0x7f7158071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.926+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f716008fd30 con 0x7f717815a610 2024-09-10T11:47:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.926+0000 7f717659c640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f715806f710 0x7f7158071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.926+0000 7f717659c640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f715806f710 0x7f7158071bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71680af000 tx=0x7f716801b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:27.930+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f716005cde0 con 0x7f717815a610 2024-09-10T11:47:28.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.074+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71780aef10 con 0x7f717815a610 2024-09-10T11:47:28.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f716f7fe640 1 -- 172.21.15.78:0/666524214 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16670 (secure 0 0 0) 0x7f7160065290 con 0x7f717815a610 2024-09-10T11:47:28.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:28.080 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:27.062225+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:47:24.833218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:47:26.032089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f715806f710 msgr2=0x7f7158071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f715806f710 0x7f7158071bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71680af000 tx=0x7f716801b0f0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 msgr2=0x7f71780b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f71780b03f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f716000d980 tx=0x7f716000de40 comp rx=0 tx=0).stop 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 shutdown_connections 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f717815e1f0 0x7f71781597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f715806f710 0x7f7158071bd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f717815a610 0x7f71780b03f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 --2- 172.21.15.78:0/666524214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f717806f870 0x7f71781511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 >> 172.21.15.78:0/666524214 conn(0x7f71780cf7c0 msgr2=0x7f7178155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:28.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 shutdown_connections 2024-09-10T11:47:28.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.078+0000 7f717c990640 1 -- 172.21.15.78:0/666524214 wait complete. 2024-09-10T11:47:28.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- 172.21.15.78:0/3007767481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 msgr2=0x7fb0bc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/3007767481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0bc003e30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009b90 tx=0x7fb0c401d210 comp rx=0 tx=0).stop 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d90ba640 1 -- 172.21.15.78:0/3007767481 reap_dead start 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- 172.21.15.78:0/3007767481 shutdown_connections 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- 172.21.15.78:0/3007767481 >> 172.21.15.78:0/3007767481 conn(0x7fb0d40d19f0 msgr2=0x7fb0d40d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- 172.21.15.78:0/3007767481 shutdown_connections 2024-09-10T11:47:28.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- 172.21.15.78:0/3007767481 wait complete. 2024-09-10T11:47:28.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 Processor -- start 2024-09-10T11:47:28.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- start start 2024-09-10T11:47:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0d415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0d4159e90 0x7fb0d4159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d40b6da0 0x7fb0d40b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4166be0 con 0x7fb0bc003a10 2024-09-10T11:47:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4166a60 con 0x7fb0d40b6da0 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0dab1d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d4166d60 con 0x7fb0d4159e90 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0d415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0d415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59194/0 (socket says 172.21.15.78:59194) 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 -- 172.21.15.78:0/552096443 learned_addr learned my addr 172.21.15.78:0/552096443 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d90ba640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d40b6da0 0x7fb0d40b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d3fff640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0d4159e90 0x7fb0d4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 -- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0d4159e90 msgr2=0x7fb0d4159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0d4159e90 0x7fb0d4159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 -- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d40b6da0 msgr2=0x7fb0d40b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.218+0000 7fb0d88b9640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d40b6da0 0x7fb0d40b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d88b9640 1 -- 172.21.15.78:0/552096443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d4165530 con 0x7fb0bc003a10 2024-09-10T11:47:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d88b9640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0d415a360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40af040 tx=0x7fb0c4005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:28.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40ba070 con 0x7fb0bc003a10 2024-09-10T11:47:28.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0c40048d0 con 0x7fb0bc003a10 2024-09-10T11:47:28.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d40b5620 con 0x7fb0bc003a10 2024-09-10T11:47:28.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40b1040 con 0x7fb0bc003a10 2024-09-10T11:47:28.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d4165250 con 0x7fb0bc003a10 2024-09-10T11:47:28.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d415bcf0 con 0x7fb0bc003a10 2024-09-10T11:47:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb0c4004d20 con 0x7fb0bc003a10 2024-09-10T11:47:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d17fa640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb0c006f740 0x7fb0c0071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0c4129f90 con 0x7fb0bc003a10 2024-09-10T11:47:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d3fff640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb0c006f740 0x7fb0c0071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.222+0000 7fb0d3fff640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb0c006f740 0x7fb0c0071c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8005d10 tx=0x7fb0c8005c80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.226+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb0c40c4020 con 0x7fb0bc003a10 2024-09-10T11:47:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.374+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0d40afc20 con 0x7fb0bc003a10 2024-09-10T11:47:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.374+0000 7fb0d17fa640 1 -- 172.21.15.78:0/552096443 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16670 (secure 0 0 0) 0x7fb0d4165530 con 0x7fb0bc003a10 2024-09-10T11:47:28.378 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:28.378 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:27.062225+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:47:24.833218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:47:26.032089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb0c006f740 msgr2=0x7fb0c0071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb0c006f740 0x7fb0c0071c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8005d10 tx=0x7fb0c8005c80 comp rx=0 tx=0).stop 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 msgr2=0x7fb0d415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0d415a360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40af040 tx=0x7fb0c4005620 comp rx=0 tx=0).stop 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 shutdown_connections 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d40b6da0 0x7fb0d40b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb0c006f740 0x7fb0c0071c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0d4159e90 0x7fb0d4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 --2- 172.21.15.78:0/552096443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0bc003a10 0x7fb0d415a360 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 >> 172.21.15.78:0/552096443 conn(0x7fb0d40d19f0 msgr2=0x7fb0d4071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 shutdown_connections 2024-09-10T11:47:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.378+0000 7fb0dab1d640 1 -- 172.21.15.78:0/552096443 wait complete. 2024-09-10T11:47:28.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 -- 172.21.15.78:0/600864560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c070180 msgr2=0x7f3e3c0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/600864560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c070180 0x7f3e3c0b4800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009c80 tx=0x7f3e3401cd70 comp rx=0 tx=0).stop 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 -- 172.21.15.78:0/600864560 shutdown_connections 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/600864560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c070180 0x7f3e3c0b4800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/600864560 >> v2:172.21.15.112:3300/0 conn(0x7f3e3c0d0400 0x7f3e3c0b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 -- 172.21.15.78:0/600864560 >> 172.21.15.78:0/600864560 conn(0x7f3e3c0d09b0 msgr2=0x7f3e3c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 -- 172.21.15.78:0/600864560 shutdown_connections 2024-09-10T11:47:28.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.518+0000 7f3e41f0e640 1 -- 172.21.15.78:0/600864560 wait complete. 2024-09-10T11:47:28.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 Processor -- start 2024-09-10T11:47:28.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- start start 2024-09-10T11:47:28.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c070180 0x7f3e3c14e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c0b3960 0x7f3e3c14dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 0x7f3e3c144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c167e10 con 0x7f3e3c0d0400 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c167c90 con 0x7f3e3c070180 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3c167f90 con 0x7f3e3c0b3960 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 0x7f3e3c144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 0x7f3e3c144c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59204/0 (socket says 172.21.15.78:59204) 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 -- 172.21.15.78:0/1356152433 learned_addr learned my addr 172.21.15.78:0/1356152433 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3affd640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c0b3960 0x7f3e3c14dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3b7fe640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c070180 0x7f3e3c14e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 -- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c0b3960 msgr2=0x7f3e3c14dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c0b3960 0x7f3e3c14dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 -- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c070180 msgr2=0x7f3e3c14e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c070180 0x7f3e3c14e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 -- 172.21.15.78:0/1356152433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c1f6620 con 0x7f3e3c0d0400 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3b7fe640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c070180 0x7f3e3c14e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e3bfff640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 0x7f3e3c144c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009bd0 tx=0x7f3e34003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e340bb070 con 0x7f3e3c0d0400 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e34004e00 con 0x7f3e3c0d0400 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3c143250 con 0x7f3e3c0d0400 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e340b2040 con 0x7f3e3c0d0400 2024-09-10T11:47:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3c14e1e0 con 0x7f3e3c0d0400 2024-09-10T11:47:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.522+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3c15e4a0 con 0x7f3e3c0d0400 2024-09-10T11:47:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.526+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f3e340be070 con 0x7f3e3c0d0400 2024-09-10T11:47:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.526+0000 7f3e23fff640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3e2806f740 0x7f3e28071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.526+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3e34129730 con 0x7f3e3c0d0400 2024-09-10T11:47:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.526+0000 7f3e3b7fe640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3e2806f740 0x7f3e28071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.526+0000 7f3e3b7fe640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3e2806f740 0x7f3e28071c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009ac0 tx=0x7f3e2c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.530+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f3e34016990 con 0x7f3e3c0d0400 2024-09-10T11:47:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.698+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3e3c14bb90 con 0x7f3e3c0d0400 2024-09-10T11:47:28.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e23fff640 1 -- 172.21.15.78:0/1356152433 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f3e340f6700 con 0x7f3e3c0d0400 2024-09-10T11:47:28.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3e2806f740 msgr2=0x7f3e28071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3e2806f740 0x7f3e28071c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009ac0 tx=0x7f3e2c0091e0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 msgr2=0x7f3e3c144c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 0x7f3e3c144c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009bd0 tx=0x7f3e34003f40 comp rx=0 tx=0).stop 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 shutdown_connections 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3e2806f740 0x7f3e28071c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c0d0400 0x7f3e3c144c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e3c0b3960 0x7f3e3c14dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 --2- 172.21.15.78:0/1356152433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c070180 0x7f3e3c14e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 >> 172.21.15.78:0/1356152433 conn(0x7f3e3c0d09b0 msgr2=0x7f3e3c14ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 shutdown_connections 2024-09-10T11:47:28.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.762+0000 7f3e41f0e640 1 -- 172.21.15.78:0/1356152433 wait complete. 2024-09-10T11:47:28.782 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T11:47:28.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T11:47:28.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3672918621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb440b3290 msgr2=0x7fdb4406df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3672918621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb440b3290 0x7fdb4406df40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb440b4ad0 tx=0x7fdb3801ccc0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3672918621 shutdown_connections 2024-09-10T11:47:28.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3672918621 >> v2:172.21.15.112:3300/0 conn(0x7fdb4406e480 0x7fdb44072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3672918621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb440b3290 0x7fdb4406df40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3672918621 >> 172.21.15.78:0/3672918621 conn(0x7fdb440b1970 msgr2=0x7fdb440b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3672918621 shutdown_connections 2024-09-10T11:47:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3672918621 wait complete. 2024-09-10T11:47:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 Processor -- start 2024-09-10T11:47:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.910+0000 7fdb4a9a7640 1 -- start start 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 0x7fdb44152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb440b3290 0x7fdb4415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb44140450 0x7fdb44153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb44166d10 con 0x7fdb4406e480 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb440739a0 con 0x7fdb44140450 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdb44166e90 con 0x7fdb440b3290 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 0x7fdb44152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 0x7fdb44152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59228/0 (socket says 172.21.15.78:59228) 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 -- 172.21.15.78:0/3758152579 learned_addr learned my addr 172.21.15.78:0/3758152579 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:28.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb437fe640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb440b3290 0x7fdb4415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 -- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb440b3290 msgr2=0x7fdb4415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb48f44640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb44140450 0x7fdb44153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb440b3290 0x7fdb4415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 -- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb44140450 msgr2=0x7fdb44153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb44140450 0x7fdb44153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 -- 172.21.15.78:0/3758152579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4413f240 con 0x7fdb4406e480 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb43fff640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 0x7fdb44152940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b3e0 tx=0x7fdb3400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34015020 con 0x7fdb4406e480 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb34011940 con 0x7fdb4406e480 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb44136bb0 con 0x7fdb4406e480 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34011d90 con 0x7fdb4406e480 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4413ef60 con 0x7fdb4406e480 2024-09-10T11:47:28.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb44072680 con 0x7fdb4406e480 2024-09-10T11:47:28.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fdb34018020 con 0x7fdb4406e480 2024-09-10T11:47:28.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb40ff9640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fdb3006f710 0x7fdb30071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:28.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdb3408f6d0 con 0x7fdb4406e480 2024-09-10T11:47:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.914+0000 7fdb437fe640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fdb3006f710 0x7fdb30071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.918+0000 7fdb437fe640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fdb3006f710 0x7fdb30071bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb380af000 tx=0x7fdb3801b500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:28.918+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fdb3401f020 con 0x7fdb4406e480 2024-09-10T11:47:29.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.094+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdb440b20d0 con 0x7fdb4406e480 2024-09-10T11:47:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.774+0000 7fdb40ff9640 1 -- 172.21.15.78:0/3758152579 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fdb3405c6a0 con 0x7fdb4406e480 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fdb3006f710 msgr2=0x7fdb30071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fdb3006f710 0x7fdb30071bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb380af000 tx=0x7fdb3801b500 comp rx=0 tx=0).stop 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 msgr2=0x7fdb44152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 0x7fdb44152940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b3e0 tx=0x7fdb3400b8a0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 shutdown_connections 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb44140450 0x7fdb44153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fdb3006f710 0x7fdb30071bd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb440b3290 0x7fdb4415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 --2- 172.21.15.78:0/3758152579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb4406e480 0x7fdb44152940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 >> 172.21.15.78:0/3758152579 conn(0x7fdb440b1970 msgr2=0x7fdb4406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 shutdown_connections 2024-09-10T11:47:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.778+0000 7fdb4a9a7640 1 -- 172.21.15.78:0/3758152579 wait complete. 2024-09-10T11:47:29.799 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T11:47:29.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/171869682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0039f0 msgr2=0x7fc95c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/171869682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0039f0 0x7fc95c003df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc96400c2e0 tx=0x7fc96401f740 comp rx=0 tx=0).stop 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 -- 172.21.15.78:0/171869682 reap_dead start 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/171869682 shutdown_connections 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/171869682 >> 172.21.15.78:0/171869682 conn(0x7fc9740cf7c0 msgr2=0x7fc9740cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/171869682 shutdown_connections 2024-09-10T11:47:29.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/171869682 wait complete. 2024-09-10T11:47:29.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 Processor -- start 2024-09-10T11:47:29.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- start start 2024-09-10T11:47:29.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95c0039f0 0x7fc974151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:29.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9741f8830 0x7fc9740cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:29.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 0x7fc9740ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc97406e700 con 0x7fc9740c4900 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc97406e580 con 0x7fc95c0039f0 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc97406e880 con 0x7fc9741f8830 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 0x7fc9740ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 0x7fc9740ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59254/0 (socket says 172.21.15.78:59254) 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 -- 172.21.15.78:0/3575863706 learned_addr learned my addr 172.21.15.78:0/3575863706 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc973fff640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95c0039f0 0x7fc974151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc9737fe640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9741f8830 0x7fc9740cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 -- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9741f8830 msgr2=0x7fc9740cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9741f8830 0x7fc9740cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 -- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95c0039f0 msgr2=0x7fc974151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95c0039f0 0x7fc974151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 -- 172.21.15.78:0/3575863706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9740cb710 con 0x7fc9740c4900 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc978e86640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 0x7fc9740ad8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc95c004790 tx=0x7fc96c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c017070 con 0x7fc9740c4900 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc96c005d50 con 0x7fc9740c4900 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9741f7d50 con 0x7fc9740c4900 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00a8a0 con 0x7fc9740c4900 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741f8310 con 0x7fc9740c4900 2024-09-10T11:47:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.926+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9740ce910 con 0x7fc9740c4900 2024-09-10T11:47:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.930+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fc96c01a070 con 0x7fc9740c4900 2024-09-10T11:47:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.930+0000 7fc970ff9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc96006f710 0x7fc960071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.930+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc96c08eac0 con 0x7fc9740c4900 2024-09-10T11:47:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.930+0000 7fc973fff640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc96006f710 0x7fc960071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.930+0000 7fc973fff640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc96006f710 0x7fc960071bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9640af000 tx=0x7fc96401c580 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:29.934+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fc96c05b9f0 con 0x7fc9740c4900 2024-09-10T11:47:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9741f84e0 con 0x7fc9740c4900 2024-09-10T11:47:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc970ff9640 1 -- 172.21.15.78:0/3575863706 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7fc96c05b2f0 con 0x7fc9740c4900 2024-09-10T11:47:30.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:30.105 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-10T11:47:29:763601+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2177635436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2177635436},{"type":"v1","addr":"172.21.15.112:6835","nonce":2177635436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2893103588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2893103588},{"type":"v1","addr":"172.21.15.112:6837","nonce":2893103588}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1361044038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1361044038},{"type":"v1","addr":"172.21.15.78:6834","nonce":1361044038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T11:47:27.062172+0000","modified":"2024-09-10T11:47:29.097457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4320":{"gid":4320,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2317375683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2317375683},{"type":"v1","addr":"172.21.15.78:6835","nonce":2317375683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4320,"qdb_cluster":[4320]},"id":1}]} 2024-09-10T11:47:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-10T11:47:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc96006f710 msgr2=0x7fc960071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc96006f710 0x7fc960071bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9640af000 tx=0x7fc96401c580 comp rx=0 tx=0).stop 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 msgr2=0x7fc9740ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 0x7fc9740ad8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc95c004790 tx=0x7fc96c00cb90 comp rx=0 tx=0).stop 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 shutdown_connections 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc96006f710 0x7fc960071bd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9740c4900 0x7fc9740ad8d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9741f8830 0x7fc9740cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.102+0000 7fc97a8e9640 1 --2- 172.21.15.78:0/3575863706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95c0039f0 0x7fc974151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.106+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 >> 172.21.15.78:0/3575863706 conn(0x7fc9740cf7c0 msgr2=0x7fc9740ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.106+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 shutdown_connections 2024-09-10T11:47:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.106+0000 7fc97a8e9640 1 -- 172.21.15.78:0/3575863706 wait complete. 2024-09-10T11:47:30.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 -- 172.21.15.78:0/1217512456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22540cc090 msgr2=0x7f225415f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 --2- 172.21.15.78:0/1217512456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22540cc090 0x7f225415f360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22540b4cc0 tx=0x7f224401cd80 comp rx=0 tx=0).stop 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 -- 172.21.15.78:0/1217512456 shutdown_connections 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 --2- 172.21.15.78:0/1217512456 >> v2:172.21.15.112:3300/0 conn(0x7f225415f8a0 0x7f225406e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 --2- 172.21.15.78:0/1217512456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22540cc090 0x7f225415f360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 -- 172.21.15.78:0/1217512456 >> 172.21.15.78:0/1217512456 conn(0x7f22540cf7c0 msgr2=0x7f22540cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 -- 172.21.15.78:0/1217512456 shutdown_connections 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 -- 172.21.15.78:0/1217512456 wait complete. 2024-09-10T11:47:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 Processor -- start 2024-09-10T11:47:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.234+0000 7f225c680640 1 -- start start 2024-09-10T11:47:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f225406e640 0x7f225413d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22540cc090 0x7f2254072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 0x7f22541648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2254168ce0 con 0x7f225415f8a0 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2254168b60 con 0x7f225406e640 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2254168e60 con 0x7f22540cc090 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 0x7f22541648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 0x7f22541648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54830/0 (socket says 172.21.15.78:54830) 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 -- 172.21.15.78:0/4227653512 learned_addr learned my addr 172.21.15.78:0/4227653512 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f2259c1b640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22540cc090 0x7f2254072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225a41c640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f225406e640 0x7f225413d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 -- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22540cc090 msgr2=0x7f2254072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22540cc090 0x7f2254072010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 -- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f225406e640 msgr2=0x7f225413d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f225406e640 0x7f225413d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 -- 172.21.15.78:0/4227653512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2254072fb0 con 0x7f225415f8a0 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225ac1d640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 0x7f22541648a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c3c0 tx=0x7f224c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c011790 con 0x7f225415f8a0 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f224c017070 con 0x7f225415f8a0 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c011cc0 con 0x7f225415f8a0 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22540729f0 con 0x7f225415f8a0 2024-09-10T11:47:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2254152f30 con 0x7f225415f8a0 2024-09-10T11:47:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225415f360 con 0x7f225415f8a0 2024-09-10T11:47:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.238+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f224c01c460 con 0x7f225415f8a0 2024-09-10T11:47:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.242+0000 7f2252ffd640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f224006f740 0x7f2240071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.242+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f224c08f570 con 0x7f225415f8a0 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.242+0000 7f225a41c640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f224006f740 0x7f2240071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.242+0000 7f225a41c640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f224006f740 0x7f2240071c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22440af000 tx=0x7f224401b5c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.242+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f224c05c540 con 0x7f225415f8a0 2024-09-10T11:47:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.386+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f225415e610 con 0x7f225415f8a0 2024-09-10T11:47:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f2252ffd640 1 -- 172.21.15.78:0/4227653512 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16657 (secure 0 0 0) 0x7f224c05be40 con 0x7f225415f8a0 2024-09-10T11:47:30.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:30.391 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:28.722562+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:47:24.833218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:47:26.032089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:30.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f224006f740 msgr2=0x7f2240071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f224006f740 0x7f2240071c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22440af000 tx=0x7f224401b5c0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 msgr2=0x7f22541648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 0x7f22541648a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c3c0 tx=0x7f224c00c880 comp rx=0 tx=0).stop 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 shutdown_connections 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f224006f740 0x7f2240071c00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f225415f8a0 0x7f22541648a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22540cc090 0x7f2254072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 --2- 172.21.15.78:0/4227653512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f225406e640 0x7f225413d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 >> 172.21.15.78:0/4227653512 conn(0x7f22540cf7c0 msgr2=0x7f2254152330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 shutdown_connections 2024-09-10T11:47:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.390+0000 7f225c680640 1 -- 172.21.15.78:0/4227653512 wait complete. 2024-09-10T11:47:30.409 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T11:47:30.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/556823795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a415b800 msgr2=0x7fc0a40ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/556823795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a415b800 0x7fc0a40ce300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009840 tx=0x7fc0a001c820 comp rx=0 tx=0).stop 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/556823795 shutdown_connections 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/556823795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a415b800 0x7fc0a40ce300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/556823795 >> 172.21.15.78:0/556823795 conn(0x7fc0a40d00a0 msgr2=0x7fc0a40d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/556823795 shutdown_connections 2024-09-10T11:47:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/556823795 wait complete. 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 Processor -- start 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- start start 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4070e30 0x7fc0a4152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 0x7fc0a413f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0a415b800 0x7fc0a415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a416a030 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a4169eb0 con 0x7fc0a4070e30 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a416a1b0 con 0x7fc0a415b800 2024-09-10T11:47:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 0x7fc0a413f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 0x7fc0a413f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54844/0 (socket says 172.21.15.78:54844) 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 -- 172.21.15.78:0/3110332912 learned_addr learned my addr 172.21.15.78:0/3110332912 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 -- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0a415b800 msgr2=0x7fc0a415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0a415b800 0x7fc0a415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 -- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4070e30 msgr2=0x7fc0a4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0a8d59640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4070e30 0x7fc0a4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4070e30 0x7fc0a4152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 -- 172.21.15.78:0/3110332912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4153190 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc09bfff640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 0x7fc0a413f980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c490 tx=0x7fc09400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094016020 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc094012940 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a4153470 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094012d90 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.534+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a4153a30 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.538+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fc094019020 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.538+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a40ceb90 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.538+0000 7fc0997fa640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09006f710 0x7fc090071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.538+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc09408f800 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.538+0000 7fc0a8d59640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09006f710 0x7fc090071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.538+0000 7fc0a8d59640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09006f710 0x7fc090071bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00af000 tx=0x7fc0a001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.542+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fc094020020 con 0x7fc0a40b4eb0 2024-09-10T11:47:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.674+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0a40b0120 con 0x7fc09006f710 2024-09-10T11:47:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.694+0000 7fc0997fa640 1 -- 172.21.15.78:0/3110332912 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239730 (secure 0 0 0) 0x7fc0a40b0120 con 0x7fc09006f710 2024-09-10T11:47:30.697 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:30.701 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09006f710 msgr2=0x7fc090071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09006f710 0x7fc090071bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00af000 tx=0x7fc0a001b060 comp rx=0 tx=0).stop 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 msgr2=0x7fc0a413f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 0x7fc0a413f980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c490 tx=0x7fc09400c950 comp rx=0 tx=0).stop 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 shutdown_connections 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09006f710 0x7fc090071bd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0a415b800 0x7fc0a415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40b4eb0 0x7fc0a413f980 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 --2- 172.21.15.78:0/3110332912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4070e30 0x7fc0a4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 >> 172.21.15.78:0/3110332912 conn(0x7fc0a40d00a0 msgr2=0x7fc0a40cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 shutdown_connections 2024-09-10T11:47:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.698+0000 7fc0aafbd640 1 -- 172.21.15.78:0/3110332912 wait complete. 2024-09-10T11:47:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T11:47:29.238735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223052,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751668,"statfs":{"total":773094113280,"available":772865708032,"internally_reserved":0,"allocated":2723840,"data_stored":1658365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001371"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716008+0000","last_change":"2024-09-10T11:47:25.716008+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716008+0000","last_undegraded":"2024-09-10T11:47:25.716008+0000","last_fullsized":"2024-09-10T11:47:25.716008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726166+0000","last_change":"2024-09-10T11:47:25.726166+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726166+0000","last_undegraded":"2024-09-10T11:47:25.726166+0000","last_fullsized":"2024-09-10T11:47:25.726166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:25.698723+0000","last_change":"2024-09-10T11:47:25.698723+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.698723+0000","last_undegraded":"2024-09-10T11:47:25.698723+0000","last_fullsized":"2024-09-10T11:47:25.698723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.722147+0000","last_change":"2024-09-10T11:47:25.722147+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.722147+0000","last_undegraded":"2024-09-10T11:47:25.722147+0000","last_fullsized":"2024-09-10T11:47:25.722147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715230+0000","last_change":"2024-09-10T11:47:25.715230+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715230+0000","last_undegraded":"2024-09-10T11:47:25.715230+0000","last_fullsized":"2024-09-10T11:47:25.715230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719769+0000","last_change":"2024-09-10T11:47:25.719769+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719769+0000","last_undegraded":"2024-09-10T11:47:25.719769+0000","last_fullsized":"2024-09-10T11:47:25.719769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727632+0000","last_change":"2024-09-10T11:47:25.727632+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727632+0000","last_undegraded":"2024-09-10T11:47:25.727632+0000","last_fullsized":"2024-09-10T11:47:25.727632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.723168+0000","last_change":"2024-09-10T11:47:25.723168+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.723168+0000","last_undegraded":"2024-09-10T11:47:25.723168+0000","last_fullsized":"2024-09-10T11:47:25.723168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727042+0000","last_change":"2024-09-10T11:47:25.727042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727042+0000","last_undegraded":"2024-09-10T11:47:25.727042+0000","last_fullsized":"2024-09-10T11:47:25.727042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.725545+0000","last_change":"2024-09-10T11:47:25.725545+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.725545+0000","last_undegraded":"2024-09-10T11:47:25.725545+0000","last_fullsized":"2024-09-10T11:47:25.725545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718917+0000","last_change":"2024-09-10T11:47:25.718917+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718917+0000","last_undegraded":"2024-09-10T11:47:25.718917+0000","last_fullsized":"2024-09-10T11:47:25.718917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718658+0000","last_change":"2024-09-10T11:47:25.718658+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718658+0000","last_undegraded":"2024-09-10T11:47:25.718658+0000","last_fullsized":"2024-09-10T11:47:25.718658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718920+0000","last_change":"2024-09-10T11:47:25.718920+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718920+0000","last_undegraded":"2024-09-10T11:47:25.718920+0000","last_fullsized":"2024-09-10T11:47:25.718920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718914+0000","last_change":"2024-09-10T11:47:25.718914+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718914+0000","last_undegraded":"2024-09-10T11:47:25.718914+0000","last_fullsized":"2024-09-10T11:47:25.718914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717042+0000","last_change":"2024-09-10T11:47:25.717042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717042+0000","last_undegraded":"2024-09-10T11:47:25.717042+0000","last_fullsized":"2024-09-10T11:47:25.717042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:25.698723+0000","last_change":"2024-09-10T11:47:25.698723+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.698723+0000","last_undegraded":"2024-09-10T11:47:25.698723+0000","last_fullsized":"2024-09-10T11:47:25.698723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T11:47:25.712005+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:25.712005+0000","last_peered":"2024-09-10T11:47:25.712005+0000","last_clean":"2024-09-10T11:47:25.712005+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:25.712005+0000","last_undegraded":"2024-09-10T11:47:25.712005+0000","last_fullsized":"2024-09-10T11:47:25.712005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720581+0000","last_change":"2024-09-10T11:47:25.720581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720581+0000","last_undegraded":"2024-09-10T11:47:25.720581+0000","last_fullsized":"2024-09-10T11:47:25.720581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720458+0000","last_change":"2024-09-10T11:47:25.720458+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720458+0000","last_undegraded":"2024-09-10T11:47:25.720458+0000","last_fullsized":"2024-09-10T11:47:25.720458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726446+0000","last_change":"2024-09-10T11:47:25.726446+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726446+0000","last_undegraded":"2024-09-10T11:47:25.726446+0000","last_fullsized":"2024-09-10T11:47:25.726446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720483+0000","last_change":"2024-09-10T11:47:25.720483+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720483+0000","last_undegraded":"2024-09-10T11:47:25.720483+0000","last_fullsized":"2024-09-10T11:47:25.720483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716757+0000","last_change":"2024-09-10T11:47:25.716757+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716757+0000","last_undegraded":"2024-09-10T11:47:25.716757+0000","last_fullsized":"2024-09-10T11:47:25.716757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720171+0000","last_change":"2024-09-10T11:47:25.720171+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720171+0000","last_undegraded":"2024-09-10T11:47:25.720171+0000","last_fullsized":"2024-09-10T11:47:25.720171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717330+0000","last_change":"2024-09-10T11:47:25.717330+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717330+0000","last_undegraded":"2024-09-10T11:47:25.717330+0000","last_fullsized":"2024-09-10T11:47:25.717330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720958+0000","last_change":"2024-09-10T11:47:25.720958+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720958+0000","last_undegraded":"2024-09-10T11:47:25.720958+0000","last_fullsized":"2024-09-10T11:47:25.720958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718773+0000","last_change":"2024-09-10T11:47:25.718773+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718773+0000","last_undegraded":"2024-09-10T11:47:25.718773+0000","last_fullsized":"2024-09-10T11:47:25.718773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720023+0000","last_change":"2024-09-10T11:47:25.720023+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720023+0000","last_undegraded":"2024-09-10T11:47:25.720023+0000","last_fullsized":"2024-09-10T11:47:25.720023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:25.698723+0000","last_change":"2024-09-10T11:47:25.698723+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.698723+0000","last_undegraded":"2024-09-10T11:47:25.698723+0000","last_fullsized":"2024-09-10T11:47:25.698723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.724926+0000","last_change":"2024-09-10T11:47:25.724926+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.724926+0000","last_undegraded":"2024-09-10T11:47:25.724926+0000","last_fullsized":"2024-09-10T11:47:25.724926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719581+0000","last_change":"2024-09-10T11:47:25.719581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719581+0000","last_undegraded":"2024-09-10T11:47:25.719581+0000","last_fullsized":"2024-09-10T11:47:25.719581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718793+0000","last_change":"2024-09-10T11:47:25.718793+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718793+0000","last_undegraded":"2024-09-10T11:47:25.718793+0000","last_fullsized":"2024-09-10T11:47:25.718793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715882+0000","last_change":"2024-09-10T11:47:25.715882+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715882+0000","last_undegraded":"2024-09-10T11:47:25.715882+0000","last_fullsized":"2024-09-10T11:47:25.715882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716972+0000","last_change":"2024-09-10T11:47:25.716972+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716972+0000","last_undegraded":"2024-09-10T11:47:25.716972+0000","last_fullsized":"2024-09-10T11:47:25.716972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:30.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:30.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 -- 172.21.15.78:0/4251962148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 msgr2=0x7faee00cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 --2- 172.21.15.78:0/4251962148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00cb380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faed8009bc0 tx=0x7faed801cb70 comp rx=0 tx=0).stop 2024-09-10T11:47:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 -- 172.21.15.78:0/4251962148 shutdown_connections 2024-09-10T11:47:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 --2- 172.21.15.78:0/4251962148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00cb380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 -- 172.21.15.78:0/4251962148 >> 172.21.15.78:0/4251962148 conn(0x7faee00d0900 msgr2=0x7faee00d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 -- 172.21.15.78:0/4251962148 shutdown_connections 2024-09-10T11:47:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.886+0000 7faee69a1640 1 -- 172.21.15.78:0/4251962148 wait complete. 2024-09-10T11:47:30.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 Processor -- start 2024-09-10T11:47:30.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- start start 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faee00caf50 0x7faee0157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faee015a780 0x7faee00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faee01689a0 con 0x7faee015b270 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faee0168820 con 0x7faee00caf50 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faee0168b20 con 0x7faee015a780 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54868/0 (socket says 172.21.15.78:54868) 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 -- 172.21.15.78:0/1050048664 learned_addr learned my addr 172.21.15.78:0/1050048664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 -- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faee015a780 msgr2=0x7faee00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedffff640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faee00caf50 0x7faee0157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedf7fe640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faee015a780 0x7faee00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faee015a780 0x7faee00c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 -- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faee00caf50 msgr2=0x7faee0157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faee00caf50 0x7faee0157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 -- 172.21.15.78:0/1050048664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee00cacd0 con 0x7faee015b270 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedffff640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faee00caf50 0x7faee0157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee4f3e640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00aed10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faed80b0040 tx=0x7faed8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80b2040 con 0x7faee015b270 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faed8004130 con 0x7faee015b270 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee00adc70 con 0x7faee015b270 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8004560 con 0x7faee015b270 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee00ae230 con 0x7faee015b270 2024-09-10T11:47:30.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee00cb360 con 0x7faee015b270 2024-09-10T11:47:30.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7faed80bd030 con 0x7faee015b270 2024-09-10T11:47:30.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedcff9640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7faecc06f710 0x7faecc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.890+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faed81298a0 con 0x7faee015b270 2024-09-10T11:47:30.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.894+0000 7faedffff640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7faecc06f710 0x7faecc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.894+0000 7faedffff640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7faecc06f710 0x7faecc071bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faed4007fd0 tx=0x7faed4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:30.894+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7faed80c4060 con 0x7faee015b270 2024-09-10T11:47:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.038+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faee015c9c0 con 0x7faecc06f710 2024-09-10T11:47:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.050+0000 7faedcff9640 1 -- 172.21.15.78:0/1050048664 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239730 (secure 0 0 0) 0x7faee015c9c0 con 0x7faecc06f710 2024-09-10T11:47:31.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7faecc06f710 msgr2=0x7faecc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7faecc06f710 0x7faecc071bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faed4007fd0 tx=0x7faed4009040 comp rx=0 tx=0).stop 2024-09-10T11:47:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 msgr2=0x7faee00aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00aed10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faed80b0040 tx=0x7faed8005b00 comp rx=0 tx=0).stop 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 shutdown_connections 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7faecc06f710 0x7faecc071bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee015b270 0x7faee00aed10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faee015a780 0x7faee00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 --2- 172.21.15.78:0/1050048664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faee00caf50 0x7faee0157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 >> 172.21.15.78:0/1050048664 conn(0x7faee00d0900 msgr2=0x7faee015cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 shutdown_connections 2024-09-10T11:47:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.054+0000 7faee69a1640 1 -- 172.21.15.78:0/1050048664 wait complete. 2024-09-10T11:47:31.072 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T11:47:29.238735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223052,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751668,"statfs":{"total":773094113280,"available":772865708032,"internally_reserved":0,"allocated":2723840,"data_stored":1658365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001371"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716008+0000","last_change":"2024-09-10T11:47:25.716008+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716008+0000","last_undegraded":"2024-09-10T11:47:25.716008+0000","last_fullsized":"2024-09-10T11:47:25.716008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726166+0000","last_change":"2024-09-10T11:47:25.726166+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726166+0000","last_undegraded":"2024-09-10T11:47:25.726166+0000","last_fullsized":"2024-09-10T11:47:25.726166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:25.698723+0000","last_change":"2024-09-10T11:47:25.698723+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.698723+0000","last_undegraded":"2024-09-10T11:47:25.698723+0000","last_fullsized":"2024-09-10T11:47:25.698723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.722147+0000","last_change":"2024-09-10T11:47:25.722147+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.722147+0000","last_undegraded":"2024-09-10T11:47:25.722147+0000","last_fullsized":"2024-09-10T11:47:25.722147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715230+0000","last_change":"2024-09-10T11:47:25.715230+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715230+0000","last_undegraded":"2024-09-10T11:47:25.715230+0000","last_fullsized":"2024-09-10T11:47:25.715230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719769+0000","last_change":"2024-09-10T11:47:25.719769+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719769+0000","last_undegraded":"2024-09-10T11:47:25.719769+0000","last_fullsized":"2024-09-10T11:47:25.719769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727632+0000","last_change":"2024-09-10T11:47:25.727632+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727632+0000","last_undegraded":"2024-09-10T11:47:25.727632+0000","last_fullsized":"2024-09-10T11:47:25.727632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.723168+0000","last_change":"2024-09-10T11:47:25.723168+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.723168+0000","last_undegraded":"2024-09-10T11:47:25.723168+0000","last_fullsized":"2024-09-10T11:47:25.723168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727042+0000","last_change":"2024-09-10T11:47:25.727042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727042+0000","last_undegraded":"2024-09-10T11:47:25.727042+0000","last_fullsized":"2024-09-10T11:47:25.727042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.725545+0000","last_change":"2024-09-10T11:47:25.725545+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.725545+0000","last_undegraded":"2024-09-10T11:47:25.725545+0000","last_fullsized":"2024-09-10T11:47:25.725545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718917+0000","last_change":"2024-09-10T11:47:25.718917+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718917+0000","last_undegraded":"2024-09-10T11:47:25.718917+0000","last_fullsized":"2024-09-10T11:47:25.718917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718658+0000","last_change":"2024-09-10T11:47:25.718658+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718658+0000","last_undegraded":"2024-09-10T11:47:25.718658+0000","last_fullsized":"2024-09-10T11:47:25.718658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718920+0000","last_change":"2024-09-10T11:47:25.718920+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718920+0000","last_undegraded":"2024-09-10T11:47:25.718920+0000","last_fullsized":"2024-09-10T11:47:25.718920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718914+0000","last_change":"2024-09-10T11:47:25.718914+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718914+0000","last_undegraded":"2024-09-10T11:47:25.718914+0000","last_fullsized":"2024-09-10T11:47:25.718914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717042+0000","last_change":"2024-09-10T11:47:25.717042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717042+0000","last_undegraded":"2024-09-10T11:47:25.717042+0000","last_fullsized":"2024-09-10T11:47:25.717042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:25.698723+0000","last_change":"2024-09-10T11:47:25.698723+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.698723+0000","last_undegraded":"2024-09-10T11:47:25.698723+0000","last_fullsized":"2024-09-10T11:47:25.698723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T11:47:25.712005+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:25.712005+0000","last_peered":"2024-09-10T11:47:25.712005+0000","last_clean":"2024-09-10T11:47:25.712005+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:25.712005+0000","last_undegraded":"2024-09-10T11:47:25.712005+0000","last_fullsized":"2024-09-10T11:47:25.712005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720581+0000","last_change":"2024-09-10T11:47:25.720581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720581+0000","last_undegraded":"2024-09-10T11:47:25.720581+0000","last_fullsized":"2024-09-10T11:47:25.720581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720458+0000","last_change":"2024-09-10T11:47:25.720458+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720458+0000","last_undegraded":"2024-09-10T11:47:25.720458+0000","last_fullsized":"2024-09-10T11:47:25.720458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726446+0000","last_change":"2024-09-10T11:47:25.726446+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726446+0000","last_undegraded":"2024-09-10T11:47:25.726446+0000","last_fullsized":"2024-09-10T11:47:25.726446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720483+0000","last_change":"2024-09-10T11:47:25.720483+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720483+0000","last_undegraded":"2024-09-10T11:47:25.720483+0000","last_fullsized":"2024-09-10T11:47:25.720483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716757+0000","last_change":"2024-09-10T11:47:25.716757+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716757+0000","last_undegraded":"2024-09-10T11:47:25.716757+0000","last_fullsized":"2024-09-10T11:47:25.716757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720171+0000","last_change":"2024-09-10T11:47:25.720171+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720171+0000","last_undegraded":"2024-09-10T11:47:25.720171+0000","last_fullsized":"2024-09-10T11:47:25.720171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717330+0000","last_change":"2024-09-10T11:47:25.717330+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717330+0000","last_undegraded":"2024-09-10T11:47:25.717330+0000","last_fullsized":"2024-09-10T11:47:25.717330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720958+0000","last_change":"2024-09-10T11:47:25.720958+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720958+0000","last_undegraded":"2024-09-10T11:47:25.720958+0000","last_fullsized":"2024-09-10T11:47:25.720958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718773+0000","last_change":"2024-09-10T11:47:25.718773+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718773+0000","last_undegraded":"2024-09-10T11:47:25.718773+0000","last_fullsized":"2024-09-10T11:47:25.718773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720023+0000","last_change":"2024-09-10T11:47:25.720023+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720023+0000","last_undegraded":"2024-09-10T11:47:25.720023+0000","last_fullsized":"2024-09-10T11:47:25.720023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:25.698723+0000","last_change":"2024-09-10T11:47:25.698723+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.698723+0000","last_undegraded":"2024-09-10T11:47:25.698723+0000","last_fullsized":"2024-09-10T11:47:25.698723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.724926+0000","last_change":"2024-09-10T11:47:25.724926+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.724926+0000","last_undegraded":"2024-09-10T11:47:25.724926+0000","last_fullsized":"2024-09-10T11:47:25.724926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719581+0000","last_change":"2024-09-10T11:47:25.719581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719581+0000","last_undegraded":"2024-09-10T11:47:25.719581+0000","last_fullsized":"2024-09-10T11:47:25.719581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718793+0000","last_change":"2024-09-10T11:47:25.718793+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718793+0000","last_undegraded":"2024-09-10T11:47:25.718793+0000","last_fullsized":"2024-09-10T11:47:25.718793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715882+0000","last_change":"2024-09-10T11:47:25.715882+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715882+0000","last_undegraded":"2024-09-10T11:47:25.715882+0000","last_fullsized":"2024-09-10T11:47:25.715882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716972+0000","last_change":"2024-09-10T11:47:25.716972+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716972+0000","last_undegraded":"2024-09-10T11:47:25.716972+0000","last_fullsized":"2024-09-10T11:47:25.716972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:31.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- 172.21.15.78:0/3407960839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16800052f0 msgr2=0x7f168000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 --2- 172.21.15.78:0/3407960839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16800052f0 0x7f168000b9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c610 tx=0x7f168c01d2a0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- 172.21.15.78:0/3407960839 shutdown_connections 2024-09-10T11:47:31.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 --2- 172.21.15.78:0/3407960839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16800052f0 0x7f168000b9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- 172.21.15.78:0/3407960839 >> 172.21.15.78:0/3407960839 conn(0x7f16940d3c80 msgr2=0x7f16940d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:31.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- 172.21.15.78:0/3407960839 shutdown_connections 2024-09-10T11:47:31.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- 172.21.15.78:0/3407960839 wait complete. 2024-09-10T11:47:31.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 Processor -- start 2024-09-10T11:47:31.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- start start 2024-09-10T11:47:31.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16800052f0 0x7f16940b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 0x7f1694149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1694149bf0 0x7f169414a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16940d0540 con 0x7f1694148da0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f16940d4bf0 con 0x7f1694149bf0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.238+0000 7f169c782640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f16940d06c0 con 0x7f16800052f0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 0x7f1694149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 0x7f1694149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54886/0 (socket says 172.21.15.78:54886) 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 -- 172.21.15.78:0/4175024081 learned_addr learned my addr 172.21.15.78:0/4175024081 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169a51e640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16800052f0 0x7f16940b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 -- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16800052f0 msgr2=0x7f16940b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16800052f0 0x7f16940b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 -- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1694149bf0 msgr2=0x7f169414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169ad1f640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1694149bf0 0x7f169414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1694149bf0 0x7f169414a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 -- 172.21.15.78:0/4175024081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16940b9100 con 0x7f1694148da0 2024-09-10T11:47:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f1699d1d640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 0x7f1694149200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f168400e960 tx=0x7f168400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:31.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400cc60 con 0x7f1694148da0 2024-09-10T11:47:31.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1684005020 con 0x7f1694148da0 2024-09-10T11:47:31.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16940b93b0 con 0x7f1694148da0 2024-09-10T11:47:31.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684005430 con 0x7f1694148da0 2024-09-10T11:47:31.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941e6a50 con 0x7f1694148da0 2024-09-10T11:47:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16940d0c20 con 0x7f1694148da0 2024-09-10T11:47:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f16840047b0 con 0x7f1694148da0 2024-09-10T11:47:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f168affd640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f167806f740 0x7f1678071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1684090100 con 0x7f1694148da0 2024-09-10T11:47:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169a51e640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f167806f740 0x7f1678071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.242+0000 7f169a51e640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f167806f740 0x7f1678071c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1690000f30 tx=0x7f16900069d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:31.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.246+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1684016030 con 0x7f1694148da0 2024-09-10T11:47:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.390+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16940b2120 con 0x7f167806f740 2024-09-10T11:47:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f168affd640 1 -- 172.21.15.78:0/4175024081 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241330 (secure 0 0 0) 0x7f16940b2120 con 0x7f167806f740 2024-09-10T11:47:31.404 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f167806f740 msgr2=0x7f1678071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f167806f740 0x7f1678071c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1690000f30 tx=0x7f16900069d0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 msgr2=0x7f1694149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 0x7f1694149200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f168400e960 tx=0x7f168400ee20 comp rx=0 tx=0).stop 2024-09-10T11:47:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 shutdown_connections 2024-09-10T11:47:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1694149bf0 0x7f169414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f167806f740 0x7f1678071c00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1694148da0 0x7f1694149200 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 --2- 172.21.15.78:0/4175024081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16800052f0 0x7f16940b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 >> 172.21.15.78:0/4175024081 conn(0x7f16940d3c80 msgr2=0x7f16940b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 shutdown_connections 2024-09-10T11:47:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.402+0000 7f169c782640 1 -- 172.21.15.78:0/4175024081 wait complete. 2024-09-10T11:47:31.423 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-10T11:47:31.239332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223096,"kb_used_data":2708,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751624,"statfs":{"total":773094113280,"available":772865662976,"internally_reserved":0,"allocated":2772992,"data_stored":1683532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.527207"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028088+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:47:29.028088+0000","last_peered":"2024-09-10T11:47:29.028088+0000","last_clean":"2024-09-10T11:47:29.028088+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:47:29.028088+0000","last_undegraded":"2024-09-10T11:47:29.028088+0000","last_fullsized":"2024-09-10T11:47:29.028088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027598+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:47:29.027598+0000","last_peered":"2024-09-10T11:47:29.027598+0000","last_clean":"2024-09-10T11:47:29.027598+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:47:29.027598+0000","last_undegraded":"2024-09-10T11:47:29.027598+0000","last_fullsized":"2024-09-10T11:47:29.027598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028342+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:47:29.028342+0000","last_peered":"2024-09-10T11:47:29.028342+0000","last_clean":"2024-09-10T11:47:29.028342+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:47:29.028342+0000","last_undegraded":"2024-09-10T11:47:29.028342+0000","last_fullsized":"2024-09-10T11:47:29.028342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027954+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:47:29.027954+0000","last_peered":"2024-09-10T11:47:29.027954+0000","last_clean":"2024-09-10T11:47:29.027954+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:47:29.027954+0000","last_undegraded":"2024-09-10T11:47:29.027954+0000","last_fullsized":"2024-09-10T11:47:29.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716008+0000","last_change":"2024-09-10T11:47:25.716008+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716008+0000","last_undegraded":"2024-09-10T11:47:25.716008+0000","last_fullsized":"2024-09-10T11:47:25.716008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726166+0000","last_change":"2024-09-10T11:47:25.726166+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726166+0000","last_undegraded":"2024-09-10T11:47:25.726166+0000","last_fullsized":"2024-09-10T11:47:25.726166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027197+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:47:29.027197+0000","last_peered":"2024-09-10T11:47:29.027197+0000","last_clean":"2024-09-10T11:47:29.027197+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:47:29.027197+0000","last_undegraded":"2024-09-10T11:47:29.027197+0000","last_fullsized":"2024-09-10T11:47:29.027197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.722147+0000","last_change":"2024-09-10T11:47:25.722147+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.722147+0000","last_undegraded":"2024-09-10T11:47:25.722147+0000","last_fullsized":"2024-09-10T11:47:25.722147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715230+0000","last_change":"2024-09-10T11:47:25.715230+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715230+0000","last_undegraded":"2024-09-10T11:47:25.715230+0000","last_fullsized":"2024-09-10T11:47:25.715230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719769+0000","last_change":"2024-09-10T11:47:25.719769+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719769+0000","last_undegraded":"2024-09-10T11:47:25.719769+0000","last_fullsized":"2024-09-10T11:47:25.719769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727632+0000","last_change":"2024-09-10T11:47:25.727632+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727632+0000","last_undegraded":"2024-09-10T11:47:25.727632+0000","last_fullsized":"2024-09-10T11:47:25.727632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.723168+0000","last_change":"2024-09-10T11:47:25.723168+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.723168+0000","last_undegraded":"2024-09-10T11:47:25.723168+0000","last_fullsized":"2024-09-10T11:47:25.723168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727042+0000","last_change":"2024-09-10T11:47:25.727042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727042+0000","last_undegraded":"2024-09-10T11:47:25.727042+0000","last_fullsized":"2024-09-10T11:47:25.727042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027867+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:47:29.027867+0000","last_peered":"2024-09-10T11:47:29.027867+0000","last_clean":"2024-09-10T11:47:29.027867+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:47:29.027867+0000","last_undegraded":"2024-09-10T11:47:29.027867+0000","last_fullsized":"2024-09-10T11:47:29.027867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.725545+0000","last_change":"2024-09-10T11:47:25.725545+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.725545+0000","last_undegraded":"2024-09-10T11:47:25.725545+0000","last_fullsized":"2024-09-10T11:47:25.725545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718917+0000","last_change":"2024-09-10T11:47:25.718917+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718917+0000","last_undegraded":"2024-09-10T11:47:25.718917+0000","last_fullsized":"2024-09-10T11:47:25.718917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718658+0000","last_change":"2024-09-10T11:47:25.718658+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718658+0000","last_undegraded":"2024-09-10T11:47:25.718658+0000","last_fullsized":"2024-09-10T11:47:25.718658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718920+0000","last_change":"2024-09-10T11:47:25.718920+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718920+0000","last_undegraded":"2024-09-10T11:47:25.718920+0000","last_fullsized":"2024-09-10T11:47:25.718920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718914+0000","last_change":"2024-09-10T11:47:25.718914+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718914+0000","last_undegraded":"2024-09-10T11:47:25.718914+0000","last_fullsized":"2024-09-10T11:47:25.718914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717042+0000","last_change":"2024-09-10T11:47:25.717042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717042+0000","last_undegraded":"2024-09-10T11:47:25.717042+0000","last_fullsized":"2024-09-10T11:47:25.717042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028201+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:47:29.028201+0000","last_peered":"2024-09-10T11:47:29.028201+0000","last_clean":"2024-09-10T11:47:29.028201+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:47:29.028201+0000","last_undegraded":"2024-09-10T11:47:29.028201+0000","last_fullsized":"2024-09-10T11:47:29.028201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T11:47:25.712005+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:25.712005+0000","last_peered":"2024-09-10T11:47:25.712005+0000","last_clean":"2024-09-10T11:47:25.712005+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:25.712005+0000","last_undegraded":"2024-09-10T11:47:25.712005+0000","last_fullsized":"2024-09-10T11:47:25.712005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720581+0000","last_change":"2024-09-10T11:47:25.720581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720581+0000","last_undegraded":"2024-09-10T11:47:25.720581+0000","last_fullsized":"2024-09-10T11:47:25.720581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720458+0000","last_change":"2024-09-10T11:47:25.720458+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720458+0000","last_undegraded":"2024-09-10T11:47:25.720458+0000","last_fullsized":"2024-09-10T11:47:25.720458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027527+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:47:29.027527+0000","last_peered":"2024-09-10T11:47:29.027527+0000","last_clean":"2024-09-10T11:47:29.027527+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:47:29.027527+0000","last_undegraded":"2024-09-10T11:47:29.027527+0000","last_fullsized":"2024-09-10T11:47:29.027527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726446+0000","last_change":"2024-09-10T11:47:25.726446+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726446+0000","last_undegraded":"2024-09-10T11:47:25.726446+0000","last_fullsized":"2024-09-10T11:47:25.726446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720483+0000","last_change":"2024-09-10T11:47:25.720483+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720483+0000","last_undegraded":"2024-09-10T11:47:25.720483+0000","last_fullsized":"2024-09-10T11:47:25.720483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716757+0000","last_change":"2024-09-10T11:47:25.716757+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716757+0000","last_undegraded":"2024-09-10T11:47:25.716757+0000","last_fullsized":"2024-09-10T11:47:25.716757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720171+0000","last_change":"2024-09-10T11:47:25.720171+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720171+0000","last_undegraded":"2024-09-10T11:47:25.720171+0000","last_fullsized":"2024-09-10T11:47:25.720171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028075+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:47:29.028075+0000","last_peered":"2024-09-10T11:47:29.028075+0000","last_clean":"2024-09-10T11:47:29.028075+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:47:29.028075+0000","last_undegraded":"2024-09-10T11:47:29.028075+0000","last_fullsized":"2024-09-10T11:47:29.028075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717330+0000","last_change":"2024-09-10T11:47:25.717330+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717330+0000","last_undegraded":"2024-09-10T11:47:25.717330+0000","last_fullsized":"2024-09-10T11:47:25.717330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720958+0000","last_change":"2024-09-10T11:47:25.720958+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720958+0000","last_undegraded":"2024-09-10T11:47:25.720958+0000","last_fullsized":"2024-09-10T11:47:25.720958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718773+0000","last_change":"2024-09-10T11:47:25.718773+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718773+0000","last_undegraded":"2024-09-10T11:47:25.718773+0000","last_fullsized":"2024-09-10T11:47:25.718773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720023+0000","last_change":"2024-09-10T11:47:25.720023+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720023+0000","last_undegraded":"2024-09-10T11:47:25.720023+0000","last_fullsized":"2024-09-10T11:47:25.720023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027901+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:47:29.027901+0000","last_peered":"2024-09-10T11:47:29.027901+0000","last_clean":"2024-09-10T11:47:29.027901+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:47:29.027901+0000","last_undegraded":"2024-09-10T11:47:29.027901+0000","last_fullsized":"2024-09-10T11:47:29.027901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.724926+0000","last_change":"2024-09-10T11:47:25.724926+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.724926+0000","last_undegraded":"2024-09-10T11:47:25.724926+0000","last_fullsized":"2024-09-10T11:47:25.724926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719581+0000","last_change":"2024-09-10T11:47:25.719581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719581+0000","last_undegraded":"2024-09-10T11:47:25.719581+0000","last_fullsized":"2024-09-10T11:47:25.719581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718793+0000","last_change":"2024-09-10T11:47:25.718793+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718793+0000","last_undegraded":"2024-09-10T11:47:25.718793+0000","last_fullsized":"2024-09-10T11:47:25.718793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715882+0000","last_change":"2024-09-10T11:47:25.715882+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715882+0000","last_undegraded":"2024-09-10T11:47:25.715882+0000","last_fullsized":"2024-09-10T11:47:25.715882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716972+0000","last_change":"2024-09-10T11:47:25.716972+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716972+0000","last_undegraded":"2024-09-10T11:47:25.716972+0000","last_fullsized":"2024-09-10T11:47:25.716972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:31.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-10T11:47:31.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-10T11:47:31.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-10T11:47:31.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-10T11:47:31.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-10T11:47:31.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.716008+0000', 'last_change': '2024-09-10T11:47:25.716008+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.716008+0000', 'last_undegraded': '2024-09-10T11:47:25.716008+0000', 'last_fullsized': '2024-09-10T11:47:25.716008+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.726166+0000', 'last_change': '2024-09-10T11:47:25.726166+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.726166+0000', 'last_undegraded': '2024-09-10T11:47:25.726166+0000', 'last_fullsized': '2024-09-10T11:47:25.726166+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-10T11:47:31.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.722147+0000', 'last_change': '2024-09-10T11:47:25.722147+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.722147+0000', 'last_undegraded': '2024-09-10T11:47:25.722147+0000', 'last_fullsized': '2024-09-10T11:47:25.722147+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.715230+0000', 'last_change': '2024-09-10T11:47:25.715230+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.715230+0000', 'last_undegraded': '2024-09-10T11:47:25.715230+0000', 'last_fullsized': '2024-09-10T11:47:25.715230+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-10T11:47:31.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.719769+0000', 'last_change': '2024-09-10T11:47:25.719769+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.719769+0000', 'last_undegraded': '2024-09-10T11:47:25.719769+0000', 'last_fullsized': '2024-09-10T11:47:25.719769+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.727632+0000', 'last_change': '2024-09-10T11:47:25.727632+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.727632+0000', 'last_undegraded': '2024-09-10T11:47:25.727632+0000', 'last_fullsized': '2024-09-10T11:47:25.727632+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.723168+0000', 'last_change': '2024-09-10T11:47:25.723168+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.723168+0000', 'last_undegraded': '2024-09-10T11:47:25.723168+0000', 'last_fullsized': '2024-09-10T11:47:25.723168+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-10T11:47:31.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.727042+0000', 'last_change': '2024-09-10T11:47:25.727042+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.727042+0000', 'last_undegraded': '2024-09-10T11:47:25.727042+0000', 'last_fullsized': '2024-09-10T11:47:25.727042+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.725545+0000', 'last_change': '2024-09-10T11:47:25.725545+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.725545+0000', 'last_undegraded': '2024-09-10T11:47:25.725545+0000', 'last_fullsized': '2024-09-10T11:47:25.725545+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.718917+0000', 'last_change': '2024-09-10T11:47:25.718917+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.718917+0000', 'last_undegraded': '2024-09-10T11:47:25.718917+0000', 'last_fullsized': '2024-09-10T11:47:25.718917+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-10T11:47:31.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.718658+0000', 'last_change': '2024-09-10T11:47:25.718658+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.718658+0000', 'last_undegraded': '2024-09-10T11:47:25.718658+0000', 'last_fullsized': '2024-09-10T11:47:25.718658+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.718920+0000', 'last_change': '2024-09-10T11:47:25.718920+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.718920+0000', 'last_undegraded': '2024-09-10T11:47:25.718920+0000', 'last_fullsized': '2024-09-10T11:47:25.718920+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-10T11:47:31.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.718914+0000', 'last_change': '2024-09-10T11:47:25.718914+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.718914+0000', 'last_undegraded': '2024-09-10T11:47:25.718914+0000', 'last_fullsized': '2024-09-10T11:47:25.718914+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.717042+0000', 'last_change': '2024-09-10T11:47:25.717042+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.717042+0000', 'last_undegraded': '2024-09-10T11:47:25.717042+0000', 'last_fullsized': '2024-09-10T11:47:25.717042+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.720581+0000', 'last_change': '2024-09-10T11:47:25.720581+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.720581+0000', 'last_undegraded': '2024-09-10T11:47:25.720581+0000', 'last_fullsized': '2024-09-10T11:47:25.720581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.438 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.720458+0000', 'last_change': '2024-09-10T11:47:25.720458+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.720458+0000', 'last_undegraded': '2024-09-10T11:47:25.720458+0000', 'last_fullsized': '2024-09-10T11:47:25.720458+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.726446+0000', 'last_change': '2024-09-10T11:47:25.726446+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.726446+0000', 'last_undegraded': '2024-09-10T11:47:25.726446+0000', 'last_fullsized': '2024-09-10T11:47:25.726446+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.720483+0000', 'last_change': '2024-09-10T11:47:25.720483+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.720483+0000', 'last_undegraded': '2024-09-10T11:47:25.720483+0000', 'last_fullsized': '2024-09-10T11:47:25.720483+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.439 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.716757+0000', 'last_change': '2024-09-10T11:47:25.716757+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.716757+0000', 'last_undegraded': '2024-09-10T11:47:25.716757+0000', 'last_fullsized': '2024-09-10T11:47:25.716757+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.720171+0000', 'last_change': '2024-09-10T11:47:25.720171+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.720171+0000', 'last_undegraded': '2024-09-10T11:47:25.720171+0000', 'last_fullsized': '2024-09-10T11:47:25.720171+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.717330+0000', 'last_change': '2024-09-10T11:47:25.717330+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.717330+0000', 'last_undegraded': '2024-09-10T11:47:25.717330+0000', 'last_fullsized': '2024-09-10T11:47:25.717330+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-10T11:47:31.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.720958+0000', 'last_change': '2024-09-10T11:47:25.720958+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.720958+0000', 'last_undegraded': '2024-09-10T11:47:25.720958+0000', 'last_fullsized': '2024-09-10T11:47:25.720958+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.718773+0000', 'last_change': '2024-09-10T11:47:25.718773+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.718773+0000', 'last_undegraded': '2024-09-10T11:47:25.718773+0000', 'last_fullsized': '2024-09-10T11:47:25.718773+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-10T11:47:31.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.720023+0000', 'last_change': '2024-09-10T11:47:25.720023+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.720023+0000', 'last_undegraded': '2024-09-10T11:47:25.720023+0000', 'last_fullsized': '2024-09-10T11:47:25.720023+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.724926+0000', 'last_change': '2024-09-10T11:47:25.724926+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.724926+0000', 'last_undegraded': '2024-09-10T11:47:25.724926+0000', 'last_fullsized': '2024-09-10T11:47:25.724926+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.442 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.719581+0000', 'last_change': '2024-09-10T11:47:25.719581+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.719581+0000', 'last_undegraded': '2024-09-10T11:47:25.719581+0000', 'last_fullsized': '2024-09-10T11:47:25.719581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.718793+0000', 'last_change': '2024-09-10T11:47:25.718793+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.718793+0000', 'last_undegraded': '2024-09-10T11:47:25.718793+0000', 'last_fullsized': '2024-09-10T11:47:25.718793+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.715882+0000', 'last_change': '2024-09-10T11:47:25.715882+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.715882+0000', 'last_undegraded': '2024-09-10T11:47:25.715882+0000', 'last_fullsized': '2024-09-10T11:47:25.715882+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T11:47:31.443 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-10T11:47:31.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T11:47:26.709871+0000', 'last_change': '2024-09-10T11:47:26.709871+0000', 'last_active': '2024-09-10T11:47:26.709871+0000', 'last_peered': '2024-09-10T11:47:26.709871+0000', 'last_clean': '2024-09-10T11:47:26.709871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:26.709871+0000', 'last_undegraded': '2024-09-10T11:47:26.709871+0000', 'last_fullsized': '2024-09-10T11:47:26.709871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:26.709871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T11:47:31.444 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-10T11:47:31.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T11:47:25.716972+0000', 'last_change': '2024-09-10T11:47:25.716972+0000', 'last_active': '2024-09-10T11:47:25.698723+0000', 'last_peered': '2024-09-10T11:47:25.698723+0000', 'last_clean': '2024-09-10T11:47:25.698723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T11:47:25.716972+0000', 'last_undegraded': '2024-09-10T11:47:25.716972+0000', 'last_fullsized': '2024-09-10T11:47:25.716972+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'last_clean_scrub_stamp': '2024-09-10T11:47:25.698723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T11:47:31.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- 172.21.15.78:0/2038530936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5054004810 msgr2=0x7f5054004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 --2- 172.21.15.78:0/2038530936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5054004810 0x7f5054004c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f50500016f0 tx=0x7f505001c7a0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 -- 172.21.15.78:0/2038530936 reap_dead start 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- 172.21.15.78:0/2038530936 shutdown_connections 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- 172.21.15.78:0/2038530936 >> 172.21.15.78:0/2038530936 conn(0x7f50680cf7c0 msgr2=0x7f50680cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- 172.21.15.78:0/2038530936 shutdown_connections 2024-09-10T11:47:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- 172.21.15.78:0/2038530936 wait complete. 2024-09-10T11:47:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 Processor -- start 2024-09-10T11:47:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- start start 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5054004810 0x7f5068150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50681f8770 0x7f50680adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 0x7f50681421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f506815f810 con 0x7f5068141d50 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f506815f690 con 0x7f5054004810 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f506dc75640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f506815f990 con 0x7f50681f8770 2024-09-10T11:47:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 0x7f50681421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 0x7f50681421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54902/0 (socket says 172.21.15.78:54902) 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 -- 172.21.15.78:0/2051620225 learned_addr learned my addr 172.21.15.78:0/2051620225 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f50677fe640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5054004810 0x7f5068150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5066ffd640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50681f8770 0x7f50680adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 -- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50681f8770 msgr2=0x7f50680adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50681f8770 0x7f50680adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 -- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5054004810 msgr2=0x7f5068150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5054004810 0x7f5068150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.594+0000 7f5067fff640 1 -- 172.21.15.78:0/2051620225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50681426f0 con 0x7f5068141d50 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f5067fff640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 0x7f50681421b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50680d05f0 tx=0x7f505800e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058015020 con 0x7f5068141d50 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50580119a0 con 0x7f5068141d50 2024-09-10T11:47:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50681e5c00 con 0x7f5068141d50 2024-09-10T11:47:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058011df0 con 0x7f5068141d50 2024-09-10T11:47:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50681e61c0 con 0x7f5068141d50 2024-09-10T11:47:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50680ce970 con 0x7f5068141d50 2024-09-10T11:47:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f5058018020 con 0x7f5068141d50 2024-09-10T11:47:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f505ffff640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f504806f740 0x7f5048071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f505808f820 con 0x7f5068141d50 2024-09-10T11:47:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f50677fe640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f504806f740 0x7f5048071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.598+0000 7f50677fe640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f504806f740 0x7f5048071c00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5060009f70 tx=0x7f50600096a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:31.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.602+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f505801f030 con 0x7f5068141d50 2024-09-10T11:47:31.691 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-10T11:47:31.690+0000 7f2a14895640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T11:47:31.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f50680af580 con 0x7f5068141d50 2024-09-10T11:47:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f505ffff640 1 -- 172.21.15.78:0/2051620225 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1316 (secure 0 0 0) 0x7f505805c1a0 con 0x7f5068141d50 2024-09-10T11:47:31.804 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:31.804 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","health":{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1725968836,"num_in_osds":8,"osd_in_since":1725968826,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":57},{"state_name":"creating+peering","count":29},{"state_name":"active+clean","count":11}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":228450304,"bytes_avail":772865662976,"bytes_total":773094113280,"unknown_pgs_ratio":0.58762884140014648,"inactive_pgs_ratio":0.29896906018257141},"fsmap":{"epoch":6,"btime":"2024-09-10T11:47:29:763601+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4320}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T11:47:02.312089+0000","services":{}},"progress_events":{}} 2024-09-10T11:47:31.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f504806f740 msgr2=0x7f5048071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f504806f740 0x7f5048071c00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5060009f70 tx=0x7f50600096a0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 msgr2=0x7f50681421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 0x7f50681421b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50680d05f0 tx=0x7f505800e9a0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 shutdown_connections 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f504806f740 0x7f5048071c00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5068141d50 0x7f50681421b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50681f8770 0x7f50680adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 --2- 172.21.15.78:0/2051620225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5054004810 0x7f5068150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 >> 172.21.15.78:0/2051620225 conn(0x7f50680cf7c0 msgr2=0x7f50680ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 shutdown_connections 2024-09-10T11:47:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.802+0000 7f506dc75640 1 -- 172.21.15.78:0/2051620225 wait complete. 2024-09-10T11:47:31.822 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T11:47:31.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 -- 172.21.15.78:0/1991414964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6254003a10 msgr2=0x7f6254003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1991414964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6254003a10 0x7f6254003e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f626c0b0180 tx=0x7f625c01cf70 comp rx=0 tx=0).stop 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 -- 172.21.15.78:0/1991414964 shutdown_connections 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1991414964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6254003a10 0x7f6254003e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 -- 172.21.15.78:0/1991414964 >> 172.21.15.78:0/1991414964 conn(0x7f626c0d0900 msgr2=0x7f626c0d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 -- 172.21.15.78:0/1991414964 shutdown_connections 2024-09-10T11:47:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 -- 172.21.15.78:0/1991414964 wait complete. 2024-09-10T11:47:31.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 Processor -- start 2024-09-10T11:47:31.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.946+0000 7f6271ce2640 1 -- start start 2024-09-10T11:47:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6254003a10 0x7f626c1f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c1fafb0 0x7f626c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 0x7f626c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f626c15b0c0 con 0x7f626c14e130 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f626c15af40 con 0x7f6254003a10 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f626c15b240 con 0x7f626c1fafb0 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 0x7f626c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 0x7f626c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54920/0 (socket says 172.21.15.78:54920) 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 -- 172.21.15.78:0/1816771058 learned_addr learned my addr 172.21.15.78:0/1816771058 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626affd640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c1fafb0 0x7f626c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626b7fe640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6254003a10 0x7f626c1f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 -- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c1fafb0 msgr2=0x7f626c0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c1fafb0 0x7f626c0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 -- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6254003a10 msgr2=0x7f626c1f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6254003a10 0x7f626c1f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 -- 172.21.15.78:0/1816771058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c0c99e0 con 0x7f626c14e130 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626b7fe640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6254003a10 0x7f626c1f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626affd640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c1fafb0 0x7f626c0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626bfff640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 0x7f626c15d1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f626c073060 tx=0x7f626400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264017070 con 0x7f626c14e130 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6264004c50 con 0x7f626c14e130 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264005290 con 0x7f626c14e130 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626c0c9cc0 con 0x7f626c14e130 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f626c0ca280 con 0x7f626c14e130 2024-09-10T11:47:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626c15b630 con 0x7f626c14e130 2024-09-10T11:47:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f626401a070 con 0x7f626c14e130 2024-09-10T11:47:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6253fff640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f625806f740 0x7f6258071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f626408eb00 con 0x7f626c14e130 2024-09-10T11:47:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.950+0000 7f626b7fe640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f625806f740 0x7f6258071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.954+0000 7f626b7fe640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f625806f740 0x7f6258071c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f625c0ac000 tx=0x7f625c019db0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:31.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:31.954+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f626405ba40 con 0x7f626c14e130 2024-09-10T11:47:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.094+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f626c15bfe0 con 0x7f625806f740 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.106+0000 7f6253fff640 1 -- 172.21.15.78:0/1816771058 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241330 (secure 0 0 0) 0x7f625c0f7ed0 con 0x7f625806f740 2024-09-10T11:47:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f625806f740 msgr2=0x7f6258071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f625806f740 0x7f6258071c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f625c0ac000 tx=0x7f625c019db0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 msgr2=0x7f626c15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 0x7f626c15d1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f626c073060 tx=0x7f626400c960 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 shutdown_connections 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f625806f740 0x7f6258071c00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f626c14e130 0x7f626c15d1d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c1fafb0 0x7f626c0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 --2- 172.21.15.78:0/1816771058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6254003a10 0x7f626c1f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 >> 172.21.15.78:0/1816771058 conn(0x7f626c0d0900 msgr2=0x7f626c0cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 shutdown_connections 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:32.110+0000 7f6271ce2640 1 -- 172.21.15.78:0/1816771058 wait complete. 2024-09-10T11:47:32.129 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-10T11:47:31.239332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223096,"kb_used_data":2708,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751624,"statfs":{"total":773094113280,"available":772865662976,"internally_reserved":0,"allocated":2772992,"data_stored":1683532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.527207"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028088+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:47:29.028088+0000","last_peered":"2024-09-10T11:47:29.028088+0000","last_clean":"2024-09-10T11:47:29.028088+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:47:29.028088+0000","last_undegraded":"2024-09-10T11:47:29.028088+0000","last_fullsized":"2024-09-10T11:47:29.028088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027598+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:47:29.027598+0000","last_peered":"2024-09-10T11:47:29.027598+0000","last_clean":"2024-09-10T11:47:29.027598+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:47:29.027598+0000","last_undegraded":"2024-09-10T11:47:29.027598+0000","last_fullsized":"2024-09-10T11:47:29.027598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028342+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:47:29.028342+0000","last_peered":"2024-09-10T11:47:29.028342+0000","last_clean":"2024-09-10T11:47:29.028342+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:47:29.028342+0000","last_undegraded":"2024-09-10T11:47:29.028342+0000","last_fullsized":"2024-09-10T11:47:29.028342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027954+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:47:29.027954+0000","last_peered":"2024-09-10T11:47:29.027954+0000","last_clean":"2024-09-10T11:47:29.027954+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:47:29.027954+0000","last_undegraded":"2024-09-10T11:47:29.027954+0000","last_fullsized":"2024-09-10T11:47:29.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716008+0000","last_change":"2024-09-10T11:47:25.716008+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716008+0000","last_undegraded":"2024-09-10T11:47:25.716008+0000","last_fullsized":"2024-09-10T11:47:25.716008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726166+0000","last_change":"2024-09-10T11:47:25.726166+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726166+0000","last_undegraded":"2024-09-10T11:47:25.726166+0000","last_fullsized":"2024-09-10T11:47:25.726166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027197+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:47:29.027197+0000","last_peered":"2024-09-10T11:47:29.027197+0000","last_clean":"2024-09-10T11:47:29.027197+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:47:29.027197+0000","last_undegraded":"2024-09-10T11:47:29.027197+0000","last_fullsized":"2024-09-10T11:47:29.027197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.722147+0000","last_change":"2024-09-10T11:47:25.722147+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.722147+0000","last_undegraded":"2024-09-10T11:47:25.722147+0000","last_fullsized":"2024-09-10T11:47:25.722147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715230+0000","last_change":"2024-09-10T11:47:25.715230+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715230+0000","last_undegraded":"2024-09-10T11:47:25.715230+0000","last_fullsized":"2024-09-10T11:47:25.715230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719769+0000","last_change":"2024-09-10T11:47:25.719769+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719769+0000","last_undegraded":"2024-09-10T11:47:25.719769+0000","last_fullsized":"2024-09-10T11:47:25.719769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727632+0000","last_change":"2024-09-10T11:47:25.727632+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727632+0000","last_undegraded":"2024-09-10T11:47:25.727632+0000","last_fullsized":"2024-09-10T11:47:25.727632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.723168+0000","last_change":"2024-09-10T11:47:25.723168+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.723168+0000","last_undegraded":"2024-09-10T11:47:25.723168+0000","last_fullsized":"2024-09-10T11:47:25.723168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.727042+0000","last_change":"2024-09-10T11:47:25.727042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.727042+0000","last_undegraded":"2024-09-10T11:47:25.727042+0000","last_fullsized":"2024-09-10T11:47:25.727042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027867+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:47:29.027867+0000","last_peered":"2024-09-10T11:47:29.027867+0000","last_clean":"2024-09-10T11:47:29.027867+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:47:29.027867+0000","last_undegraded":"2024-09-10T11:47:29.027867+0000","last_fullsized":"2024-09-10T11:47:29.027867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.725545+0000","last_change":"2024-09-10T11:47:25.725545+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.725545+0000","last_undegraded":"2024-09-10T11:47:25.725545+0000","last_fullsized":"2024-09-10T11:47:25.725545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718917+0000","last_change":"2024-09-10T11:47:25.718917+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718917+0000","last_undegraded":"2024-09-10T11:47:25.718917+0000","last_fullsized":"2024-09-10T11:47:25.718917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718658+0000","last_change":"2024-09-10T11:47:25.718658+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718658+0000","last_undegraded":"2024-09-10T11:47:25.718658+0000","last_fullsized":"2024-09-10T11:47:25.718658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718920+0000","last_change":"2024-09-10T11:47:25.718920+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718920+0000","last_undegraded":"2024-09-10T11:47:25.718920+0000","last_fullsized":"2024-09-10T11:47:25.718920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718914+0000","last_change":"2024-09-10T11:47:25.718914+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718914+0000","last_undegraded":"2024-09-10T11:47:25.718914+0000","last_fullsized":"2024-09-10T11:47:25.718914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717042+0000","last_change":"2024-09-10T11:47:25.717042+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717042+0000","last_undegraded":"2024-09-10T11:47:25.717042+0000","last_fullsized":"2024-09-10T11:47:25.717042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028201+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:47:29.028201+0000","last_peered":"2024-09-10T11:47:29.028201+0000","last_clean":"2024-09-10T11:47:29.028201+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:47:29.028201+0000","last_undegraded":"2024-09-10T11:47:29.028201+0000","last_fullsized":"2024-09-10T11:47:29.028201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T11:47:25.712005+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:25.712005+0000","last_peered":"2024-09-10T11:47:25.712005+0000","last_clean":"2024-09-10T11:47:25.712005+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:25.712005+0000","last_undegraded":"2024-09-10T11:47:25.712005+0000","last_fullsized":"2024-09-10T11:47:25.712005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720581+0000","last_change":"2024-09-10T11:47:25.720581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720581+0000","last_undegraded":"2024-09-10T11:47:25.720581+0000","last_fullsized":"2024-09-10T11:47:25.720581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720458+0000","last_change":"2024-09-10T11:47:25.720458+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720458+0000","last_undegraded":"2024-09-10T11:47:25.720458+0000","last_fullsized":"2024-09-10T11:47:25.720458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027527+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:47:29.027527+0000","last_peered":"2024-09-10T11:47:29.027527+0000","last_clean":"2024-09-10T11:47:29.027527+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:47:29.027527+0000","last_undegraded":"2024-09-10T11:47:29.027527+0000","last_fullsized":"2024-09-10T11:47:29.027527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.726446+0000","last_change":"2024-09-10T11:47:25.726446+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.726446+0000","last_undegraded":"2024-09-10T11:47:25.726446+0000","last_fullsized":"2024-09-10T11:47:25.726446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720483+0000","last_change":"2024-09-10T11:47:25.720483+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720483+0000","last_undegraded":"2024-09-10T11:47:25.720483+0000","last_fullsized":"2024-09-10T11:47:25.720483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716757+0000","last_change":"2024-09-10T11:47:25.716757+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716757+0000","last_undegraded":"2024-09-10T11:47:25.716757+0000","last_fullsized":"2024-09-10T11:47:25.716757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720171+0000","last_change":"2024-09-10T11:47:25.720171+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720171+0000","last_undegraded":"2024-09-10T11:47:25.720171+0000","last_fullsized":"2024-09-10T11:47:25.720171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028075+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:47:29.028075+0000","last_peered":"2024-09-10T11:47:29.028075+0000","last_clean":"2024-09-10T11:47:29.028075+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:47:29.028075+0000","last_undegraded":"2024-09-10T11:47:29.028075+0000","last_fullsized":"2024-09-10T11:47:29.028075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.717330+0000","last_change":"2024-09-10T11:47:25.717330+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.717330+0000","last_undegraded":"2024-09-10T11:47:25.717330+0000","last_fullsized":"2024-09-10T11:47:25.717330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720958+0000","last_change":"2024-09-10T11:47:25.720958+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720958+0000","last_undegraded":"2024-09-10T11:47:25.720958+0000","last_fullsized":"2024-09-10T11:47:25.720958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718773+0000","last_change":"2024-09-10T11:47:25.718773+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718773+0000","last_undegraded":"2024-09-10T11:47:25.718773+0000","last_fullsized":"2024-09-10T11:47:25.718773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.720023+0000","last_change":"2024-09-10T11:47:25.720023+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.720023+0000","last_undegraded":"2024-09-10T11:47:25.720023+0000","last_fullsized":"2024-09-10T11:47:25.720023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027901+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:47:29.027901+0000","last_peered":"2024-09-10T11:47:29.027901+0000","last_clean":"2024-09-10T11:47:29.027901+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:47:29.027901+0000","last_undegraded":"2024-09-10T11:47:29.027901+0000","last_fullsized":"2024-09-10T11:47:29.027901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.724926+0000","last_change":"2024-09-10T11:47:25.724926+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.724926+0000","last_undegraded":"2024-09-10T11:47:25.724926+0000","last_fullsized":"2024-09-10T11:47:25.724926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.719581+0000","last_change":"2024-09-10T11:47:25.719581+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.719581+0000","last_undegraded":"2024-09-10T11:47:25.719581+0000","last_fullsized":"2024-09-10T11:47:25.719581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.718793+0000","last_change":"2024-09-10T11:47:25.718793+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.718793+0000","last_undegraded":"2024-09-10T11:47:25.718793+0000","last_fullsized":"2024-09-10T11:47:25.718793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.715882+0000","last_change":"2024-09-10T11:47:25.715882+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.715882+0000","last_undegraded":"2024-09-10T11:47:25.715882+0000","last_fullsized":"2024-09-10T11:47:25.715882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:47:26.709871+0000","last_change":"2024-09-10T11:47:26.709871+0000","last_active":"2024-09-10T11:47:26.709871+0000","last_peered":"2024-09-10T11:47:26.709871+0000","last_clean":"2024-09-10T11:47:26.709871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:26.709871+0000","last_undegraded":"2024-09-10T11:47:26.709871+0000","last_fullsized":"2024-09-10T11:47:26.709871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T11:47:25.716972+0000","last_change":"2024-09-10T11:47:25.716972+0000","last_active":"2024-09-10T11:47:25.698723+0000","last_peered":"2024-09-10T11:47:25.698723+0000","last_clean":"2024-09-10T11:47:25.698723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:47:25.716972+0000","last_undegraded":"2024-09-10T11:47:25.716972+0000","last_fullsized":"2024-09-10T11:47:25.716972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:35.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- 172.21.15.78:0/1806992863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0ceeb0 msgr2=0x7f84fc06e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 --2- 172.21.15.78:0/1806992863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc06e8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009bc0 tx=0x7f84f401cae0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- 172.21.15.78:0/1806992863 shutdown_connections 2024-09-10T11:47:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 --2- 172.21.15.78:0/1806992863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc06e8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- 172.21.15.78:0/1806992863 >> 172.21.15.78:0/1806992863 conn(0x7f84fc0cf7c0 msgr2=0x7f84fc0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- 172.21.15.78:0/1806992863 shutdown_connections 2024-09-10T11:47:35.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- 172.21.15.78:0/1806992863 wait complete. 2024-09-10T11:47:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 Processor -- start 2024-09-10T11:47:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- start start 2024-09-10T11:47:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84fc0b5680 0x7f84fc145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 0x7f84fc14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc1697c0 con 0x7f84fc1528c0 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc169640 con 0x7f84fc0ceeb0 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f8501873640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f84fc169940 con 0x7f84fc0b5680 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 0x7f84fc14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 0x7f84fc14d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54932/0 (socket says 172.21.15.78:54932) 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 -- 172.21.15.78:0/251600699 learned_addr learned my addr 172.21.15.78:0/251600699 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fa7fc640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84faffd640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84fc0b5680 0x7f84fc145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 -- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84fc0b5680 msgr2=0x7f84fc145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84fc0b5680 0x7f84fc145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 -- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84fc0ceeb0 msgr2=0x7f84fc159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 -- 172.21.15.78:0/251600699 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc15a2b0 con 0x7f84fc1528c0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fa7fc640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.266+0000 7f84fb7fe640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 0x7f84fc14d2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f84f401c550 tx=0x7f84f4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40b2040 con 0x7f84fc1528c0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84f40bb070 con 0x7f84fc1528c0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84fc15a590 con 0x7f84fc1528c0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4004590 con 0x7f84fc1528c0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84fc14a480 con 0x7f84fc1528c0 2024-09-10T11:47:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84fc0b4f70 con 0x7f84fc1528c0 2024-09-10T11:47:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f84f40a5b50 con 0x7f84fc1528c0 2024-09-10T11:47:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84f3fff640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84dc06f710 0x7f84dc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f84f412a2c0 con 0x7f84fc1528c0 2024-09-10T11:47:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84faffd640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84dc06f710 0x7f84dc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.270+0000 7f84faffd640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84dc06f710 0x7f84dc071bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00a750 tx=0x7f84ec008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.274+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f84f4016790 con 0x7f84fc1528c0 2024-09-10T11:47:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.410+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84fc156060 con 0x7f84dc06f710 2024-09-10T11:47:35.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.422+0000 7f84f3fff640 1 -- 172.21.15.78:0/251600699 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251921 (secure 0 0 0) 0x7f84fc156060 con 0x7f84dc06f710 2024-09-10T11:47:35.427 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:35.430 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:35.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84dc06f710 msgr2=0x7f84dc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84dc06f710 0x7f84dc071bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00a750 tx=0x7f84ec008040 comp rx=0 tx=0).stop 2024-09-10T11:47:35.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 msgr2=0x7f84fc14d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 0x7f84fc14d2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f84f401c550 tx=0x7f84f4005b00 comp rx=0 tx=0).stop 2024-09-10T11:47:35.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 shutdown_connections 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84fc0ceeb0 0x7f84fc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84dc06f710 0x7f84dc071bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc1528c0 0x7f84fc14d2c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 --2- 172.21.15.78:0/251600699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84fc0b5680 0x7f84fc145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 >> 172.21.15.78:0/251600699 conn(0x7f84fc0cf7c0 msgr2=0x7f84fc15cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 shutdown_connections 2024-09-10T11:47:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.426+0000 7f8501873640 1 -- 172.21.15.78:0/251600699 wait complete. 2024-09-10T11:47:35.446 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-10T11:47:35.240956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223480,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751240,"statfs":{"total":773094113280,"available":772865269760,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002881"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027494+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:47:29.027494+0000","last_peered":"2024-09-10T11:47:29.027494+0000","last_clean":"2024-09-10T11:47:29.027494+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:47:29.027494+0000","last_undegraded":"2024-09-10T11:47:29.027494+0000","last_fullsized":"2024-09-10T11:47:29.027494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736580+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:47:28.736580+0000","last_peered":"2024-09-10T11:47:28.736580+0000","last_clean":"2024-09-10T11:47:28.736580+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:47:28.736580+0000","last_undegraded":"2024-09-10T11:47:28.736580+0000","last_fullsized":"2024-09-10T11:47:28.736580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735707+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:47:28.735707+0000","last_peered":"2024-09-10T11:47:28.735707+0000","last_clean":"2024-09-10T11:47:28.735707+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:47:28.735707+0000","last_undegraded":"2024-09-10T11:47:28.735707+0000","last_fullsized":"2024-09-10T11:47:28.735707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026400+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:47:29.026400+0000","last_peered":"2024-09-10T11:47:29.026400+0000","last_clean":"2024-09-10T11:47:29.026400+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:47:29.026400+0000","last_undegraded":"2024-09-10T11:47:29.026400+0000","last_fullsized":"2024-09-10T11:47:29.026400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027309+0000","last_change":"2024-09-10T11:47:27.775231+0000","last_active":"2024-09-10T11:47:29.027309+0000","last_peered":"2024-09-10T11:47:29.027309+0000","last_clean":"2024-09-10T11:47:29.027309+0000","last_became_active":"2024-09-10T11:47:27.774770+0000","last_became_peered":"2024-09-10T11:47:27.774770+0000","last_unstale":"2024-09-10T11:47:29.027309+0000","last_undegraded":"2024-09-10T11:47:29.027309+0000","last_fullsized":"2024-09-10T11:47:29.027309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:41.280383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026629+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:47:29.026629+0000","last_peered":"2024-09-10T11:47:29.026629+0000","last_clean":"2024-09-10T11:47:29.026629+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:47:29.026629+0000","last_undegraded":"2024-09-10T11:47:29.026629+0000","last_fullsized":"2024-09-10T11:47:29.026629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025616+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:47:29.025616+0000","last_peered":"2024-09-10T11:47:29.025616+0000","last_clean":"2024-09-10T11:47:29.025616+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:47:29.025616+0000","last_undegraded":"2024-09-10T11:47:29.025616+0000","last_fullsized":"2024-09-10T11:47:29.025616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.734995+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:47:28.734995+0000","last_peered":"2024-09-10T11:47:28.734995+0000","last_clean":"2024-09-10T11:47:28.734995+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:47:28.734995+0000","last_undegraded":"2024-09-10T11:47:28.734995+0000","last_fullsized":"2024-09-10T11:47:28.734995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.980094+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:47:28.980094+0000","last_peered":"2024-09-10T11:47:28.980094+0000","last_clean":"2024-09-10T11:47:28.980094+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:47:28.980094+0000","last_undegraded":"2024-09-10T11:47:28.980094+0000","last_fullsized":"2024-09-10T11:47:28.980094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027321+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:47:29.027321+0000","last_peered":"2024-09-10T11:47:29.027321+0000","last_clean":"2024-09-10T11:47:29.027321+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:47:29.027321+0000","last_undegraded":"2024-09-10T11:47:29.027321+0000","last_fullsized":"2024-09-10T11:47:29.027321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025838+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:47:29.025838+0000","last_peered":"2024-09-10T11:47:29.025838+0000","last_clean":"2024-09-10T11:47:29.025838+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:47:29.025838+0000","last_undegraded":"2024-09-10T11:47:29.025838+0000","last_fullsized":"2024-09-10T11:47:29.025838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025544+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:47:29.025544+0000","last_peered":"2024-09-10T11:47:29.025544+0000","last_clean":"2024-09-10T11:47:29.025544+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:47:29.025544+0000","last_undegraded":"2024-09-10T11:47:29.025544+0000","last_fullsized":"2024-09-10T11:47:29.025544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028088+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:47:29.028088+0000","last_peered":"2024-09-10T11:47:29.028088+0000","last_clean":"2024-09-10T11:47:29.028088+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:47:29.028088+0000","last_undegraded":"2024-09-10T11:47:29.028088+0000","last_fullsized":"2024-09-10T11:47:29.028088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027598+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:47:29.027598+0000","last_peered":"2024-09-10T11:47:29.027598+0000","last_clean":"2024-09-10T11:47:29.027598+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:47:29.027598+0000","last_undegraded":"2024-09-10T11:47:29.027598+0000","last_fullsized":"2024-09-10T11:47:29.027598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.734976+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:47:28.734976+0000","last_peered":"2024-09-10T11:47:28.734976+0000","last_clean":"2024-09-10T11:47:28.734976+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:47:28.734976+0000","last_undegraded":"2024-09-10T11:47:28.734976+0000","last_fullsized":"2024-09-10T11:47:28.734976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728711+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:47:28.728711+0000","last_peered":"2024-09-10T11:47:28.728711+0000","last_clean":"2024-09-10T11:47:28.728711+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:47:28.728711+0000","last_undegraded":"2024-09-10T11:47:28.728711+0000","last_fullsized":"2024-09-10T11:47:28.728711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729812+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:47:28.729812+0000","last_peered":"2024-09-10T11:47:28.729812+0000","last_clean":"2024-09-10T11:47:28.729812+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:47:28.729812+0000","last_undegraded":"2024-09-10T11:47:28.729812+0000","last_fullsized":"2024-09-10T11:47:28.729812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960859+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:47:28.960859+0000","last_peered":"2024-09-10T11:47:28.960859+0000","last_clean":"2024-09-10T11:47:28.960859+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:47:28.960859+0000","last_undegraded":"2024-09-10T11:47:28.960859+0000","last_fullsized":"2024-09-10T11:47:28.960859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729574+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:47:28.729574+0000","last_peered":"2024-09-10T11:47:28.729574+0000","last_clean":"2024-09-10T11:47:28.729574+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:47:28.729574+0000","last_undegraded":"2024-09-10T11:47:28.729574+0000","last_fullsized":"2024-09-10T11:47:28.729574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025283+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:47:29.025283+0000","last_peered":"2024-09-10T11:47:29.025283+0000","last_clean":"2024-09-10T11:47:29.025283+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:47:29.025283+0000","last_undegraded":"2024-09-10T11:47:29.025283+0000","last_fullsized":"2024-09-10T11:47:29.025283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737064+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:47:28.737064+0000","last_peered":"2024-09-10T11:47:28.737064+0000","last_clean":"2024-09-10T11:47:28.737064+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:47:28.737064+0000","last_undegraded":"2024-09-10T11:47:28.737064+0000","last_fullsized":"2024-09-10T11:47:28.737064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979793+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:47:28.979793+0000","last_peered":"2024-09-10T11:47:28.979793+0000","last_clean":"2024-09-10T11:47:28.979793+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:47:28.979793+0000","last_undegraded":"2024-09-10T11:47:28.979793+0000","last_fullsized":"2024-09-10T11:47:28.979793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735276+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:47:28.735276+0000","last_peered":"2024-09-10T11:47:28.735276+0000","last_clean":"2024-09-10T11:47:28.735276+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:47:28.735276+0000","last_undegraded":"2024-09-10T11:47:28.735276+0000","last_fullsized":"2024-09-10T11:47:28.735276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728453+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:47:28.728453+0000","last_peered":"2024-09-10T11:47:28.728453+0000","last_clean":"2024-09-10T11:47:28.728453+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:47:28.728453+0000","last_undegraded":"2024-09-10T11:47:28.728453+0000","last_fullsized":"2024-09-10T11:47:28.728453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735753+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:47:28.735753+0000","last_peered":"2024-09-10T11:47:28.735753+0000","last_clean":"2024-09-10T11:47:28.735753+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:47:28.735753+0000","last_undegraded":"2024-09-10T11:47:28.735753+0000","last_fullsized":"2024-09-10T11:47:28.735753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027230+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:47:29.027230+0000","last_peered":"2024-09-10T11:47:29.027230+0000","last_clean":"2024-09-10T11:47:29.027230+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:47:29.027230+0000","last_undegraded":"2024-09-10T11:47:29.027230+0000","last_fullsized":"2024-09-10T11:47:29.027230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028342+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:47:29.028342+0000","last_peered":"2024-09-10T11:47:29.028342+0000","last_clean":"2024-09-10T11:47:29.028342+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:47:29.028342+0000","last_undegraded":"2024-09-10T11:47:29.028342+0000","last_fullsized":"2024-09-10T11:47:29.028342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027954+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:47:29.027954+0000","last_peered":"2024-09-10T11:47:29.027954+0000","last_clean":"2024-09-10T11:47:29.027954+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:47:29.027954+0000","last_undegraded":"2024-09-10T11:47:29.027954+0000","last_fullsized":"2024-09-10T11:47:29.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735405+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:47:28.735405+0000","last_peered":"2024-09-10T11:47:28.735405+0000","last_clean":"2024-09-10T11:47:28.735405+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:47:28.735405+0000","last_undegraded":"2024-09-10T11:47:28.735405+0000","last_fullsized":"2024-09-10T11:47:28.735405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729094+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:47:28.729094+0000","last_peered":"2024-09-10T11:47:28.729094+0000","last_clean":"2024-09-10T11:47:28.729094+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:47:28.729094+0000","last_undegraded":"2024-09-10T11:47:28.729094+0000","last_fullsized":"2024-09-10T11:47:28.729094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960185+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:47:28.960185+0000","last_peered":"2024-09-10T11:47:28.960185+0000","last_clean":"2024-09-10T11:47:28.960185+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:47:28.960185+0000","last_undegraded":"2024-09-10T11:47:28.960185+0000","last_fullsized":"2024-09-10T11:47:28.960185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026051+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:47:29.026051+0000","last_peered":"2024-09-10T11:47:29.026051+0000","last_clean":"2024-09-10T11:47:29.026051+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:47:29.026051+0000","last_undegraded":"2024-09-10T11:47:29.026051+0000","last_fullsized":"2024-09-10T11:47:29.026051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979892+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:47:28.979892+0000","last_peered":"2024-09-10T11:47:28.979892+0000","last_clean":"2024-09-10T11:47:28.979892+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:47:28.979892+0000","last_undegraded":"2024-09-10T11:47:28.979892+0000","last_fullsized":"2024-09-10T11:47:28.979892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735001+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:47:28.735001+0000","last_peered":"2024-09-10T11:47:28.735001+0000","last_clean":"2024-09-10T11:47:28.735001+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:47:28.735001+0000","last_undegraded":"2024-09-10T11:47:28.735001+0000","last_fullsized":"2024-09-10T11:47:28.735001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737672+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:47:28.737672+0000","last_peered":"2024-09-10T11:47:28.737672+0000","last_clean":"2024-09-10T11:47:28.737672+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:47:28.737672+0000","last_undegraded":"2024-09-10T11:47:28.737672+0000","last_fullsized":"2024-09-10T11:47:28.737672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728990+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:47:28.728990+0000","last_peered":"2024-09-10T11:47:28.728990+0000","last_clean":"2024-09-10T11:47:28.728990+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:47:28.728990+0000","last_undegraded":"2024-09-10T11:47:28.728990+0000","last_fullsized":"2024-09-10T11:47:28.728990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027197+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:47:29.027197+0000","last_peered":"2024-09-10T11:47:29.027197+0000","last_clean":"2024-09-10T11:47:29.027197+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:47:29.027197+0000","last_undegraded":"2024-09-10T11:47:29.027197+0000","last_fullsized":"2024-09-10T11:47:29.027197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735590+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:47:28.735590+0000","last_peered":"2024-09-10T11:47:28.735590+0000","last_clean":"2024-09-10T11:47:28.735590+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:47:28.735590+0000","last_undegraded":"2024-09-10T11:47:28.735590+0000","last_fullsized":"2024-09-10T11:47:28.735590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728602+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:47:28.728602+0000","last_peered":"2024-09-10T11:47:28.728602+0000","last_clean":"2024-09-10T11:47:28.728602+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:47:28.728602+0000","last_undegraded":"2024-09-10T11:47:28.728602+0000","last_fullsized":"2024-09-10T11:47:28.728602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737137+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:47:28.737137+0000","last_peered":"2024-09-10T11:47:28.737137+0000","last_clean":"2024-09-10T11:47:28.737137+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:47:28.737137+0000","last_undegraded":"2024-09-10T11:47:28.737137+0000","last_fullsized":"2024-09-10T11:47:28.737137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979920+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:47:28.979920+0000","last_peered":"2024-09-10T11:47:28.979920+0000","last_clean":"2024-09-10T11:47:28.979920+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:47:28.979920+0000","last_undegraded":"2024-09-10T11:47:28.979920+0000","last_fullsized":"2024-09-10T11:47:28.979920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027801+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:47:29.027801+0000","last_peered":"2024-09-10T11:47:29.027801+0000","last_clean":"2024-09-10T11:47:29.027801+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:47:29.027801+0000","last_undegraded":"2024-09-10T11:47:29.027801+0000","last_fullsized":"2024-09-10T11:47:29.027801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025578+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:47:29.025578+0000","last_peered":"2024-09-10T11:47:29.025578+0000","last_clean":"2024-09-10T11:47:29.025578+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:47:29.025578+0000","last_undegraded":"2024-09-10T11:47:29.025578+0000","last_fullsized":"2024-09-10T11:47:29.025578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736301+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:47:28.736301+0000","last_peered":"2024-09-10T11:47:28.736301+0000","last_clean":"2024-09-10T11:47:28.736301+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:47:28.736301+0000","last_undegraded":"2024-09-10T11:47:28.736301+0000","last_fullsized":"2024-09-10T11:47:28.736301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960223+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:47:28.960223+0000","last_peered":"2024-09-10T11:47:28.960223+0000","last_clean":"2024-09-10T11:47:28.960223+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:47:28.960223+0000","last_undegraded":"2024-09-10T11:47:28.960223+0000","last_fullsized":"2024-09-10T11:47:28.960223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729007+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:47:28.729007+0000","last_peered":"2024-09-10T11:47:28.729007+0000","last_clean":"2024-09-10T11:47:28.729007+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:47:28.729007+0000","last_undegraded":"2024-09-10T11:47:28.729007+0000","last_fullsized":"2024-09-10T11:47:28.729007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026465+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:47:29.026465+0000","last_peered":"2024-09-10T11:47:29.026465+0000","last_clean":"2024-09-10T11:47:29.026465+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:47:29.026465+0000","last_undegraded":"2024-09-10T11:47:29.026465+0000","last_fullsized":"2024-09-10T11:47:29.026465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026349+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:47:29.026349+0000","last_peered":"2024-09-10T11:47:29.026349+0000","last_clean":"2024-09-10T11:47:29.026349+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:47:29.026349+0000","last_undegraded":"2024-09-10T11:47:29.026349+0000","last_fullsized":"2024-09-10T11:47:29.026349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960162+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:47:28.960162+0000","last_peered":"2024-09-10T11:47:28.960162+0000","last_clean":"2024-09-10T11:47:28.960162+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:47:28.960162+0000","last_undegraded":"2024-09-10T11:47:28.960162+0000","last_fullsized":"2024-09-10T11:47:28.960162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027867+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:47:29.027867+0000","last_peered":"2024-09-10T11:47:29.027867+0000","last_clean":"2024-09-10T11:47:29.027867+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:47:29.027867+0000","last_undegraded":"2024-09-10T11:47:29.027867+0000","last_fullsized":"2024-09-10T11:47:29.027867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729129+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:47:28.729129+0000","last_peered":"2024-09-10T11:47:28.729129+0000","last_clean":"2024-09-10T11:47:28.729129+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:47:28.729129+0000","last_undegraded":"2024-09-10T11:47:28.729129+0000","last_fullsized":"2024-09-10T11:47:28.729129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729289+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:47:28.729289+0000","last_peered":"2024-09-10T11:47:28.729289+0000","last_clean":"2024-09-10T11:47:28.729289+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:47:28.729289+0000","last_undegraded":"2024-09-10T11:47:28.729289+0000","last_fullsized":"2024-09-10T11:47:28.729289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025764+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:47:29.025764+0000","last_peered":"2024-09-10T11:47:29.025764+0000","last_clean":"2024-09-10T11:47:29.025764+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:47:29.025764+0000","last_undegraded":"2024-09-10T11:47:29.025764+0000","last_fullsized":"2024-09-10T11:47:29.025764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979529+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:47:28.979529+0000","last_peered":"2024-09-10T11:47:28.979529+0000","last_clean":"2024-09-10T11:47:28.979529+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:47:28.979529+0000","last_undegraded":"2024-09-10T11:47:28.979529+0000","last_fullsized":"2024-09-10T11:47:28.979529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736199+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:47:28.736199+0000","last_peered":"2024-09-10T11:47:28.736199+0000","last_clean":"2024-09-10T11:47:28.736199+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:47:28.736199+0000","last_undegraded":"2024-09-10T11:47:28.736199+0000","last_fullsized":"2024-09-10T11:47:28.736199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728908+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:47:28.728908+0000","last_peered":"2024-09-10T11:47:28.728908+0000","last_clean":"2024-09-10T11:47:28.728908+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:47:28.728908+0000","last_undegraded":"2024-09-10T11:47:28.728908+0000","last_fullsized":"2024-09-10T11:47:28.728908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027636+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:47:29.027636+0000","last_peered":"2024-09-10T11:47:29.027636+0000","last_clean":"2024-09-10T11:47:29.027636+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:47:29.027636+0000","last_undegraded":"2024-09-10T11:47:29.027636+0000","last_fullsized":"2024-09-10T11:47:29.027636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027946+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:47:29.027946+0000","last_peered":"2024-09-10T11:47:29.027946+0000","last_clean":"2024-09-10T11:47:29.027946+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:47:29.027946+0000","last_undegraded":"2024-09-10T11:47:29.027946+0000","last_fullsized":"2024-09-10T11:47:29.027946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737330+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:47:28.737330+0000","last_peered":"2024-09-10T11:47:28.737330+0000","last_clean":"2024-09-10T11:47:28.737330+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:47:28.737330+0000","last_undegraded":"2024-09-10T11:47:28.737330+0000","last_fullsized":"2024-09-10T11:47:28.737330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027844+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:47:29.027844+0000","last_peered":"2024-09-10T11:47:29.027844+0000","last_clean":"2024-09-10T11:47:29.027844+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:47:29.027844+0000","last_undegraded":"2024-09-10T11:47:29.027844+0000","last_fullsized":"2024-09-10T11:47:29.027844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735825+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:47:28.735825+0000","last_peered":"2024-09-10T11:47:28.735825+0000","last_clean":"2024-09-10T11:47:28.735825+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:47:28.735825+0000","last_undegraded":"2024-09-10T11:47:28.735825+0000","last_fullsized":"2024-09-10T11:47:28.735825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026767+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:47:29.026767+0000","last_peered":"2024-09-10T11:47:29.026767+0000","last_clean":"2024-09-10T11:47:29.026767+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:47:29.026767+0000","last_undegraded":"2024-09-10T11:47:29.026767+0000","last_fullsized":"2024-09-10T11:47:29.026767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028201+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:47:29.028201+0000","last_peered":"2024-09-10T11:47:29.028201+0000","last_clean":"2024-09-10T11:47:29.028201+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:47:29.028201+0000","last_undegraded":"2024-09-10T11:47:29.028201+0000","last_fullsized":"2024-09-10T11:47:29.028201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729404+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:47:28.729404+0000","last_peered":"2024-09-10T11:47:28.729404+0000","last_clean":"2024-09-10T11:47:28.729404+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:47:28.729404+0000","last_undegraded":"2024-09-10T11:47:28.729404+0000","last_fullsized":"2024-09-10T11:47:28.729404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979210+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:28.979210+0000","last_peered":"2024-09-10T11:47:28.979210+0000","last_clean":"2024-09-10T11:47:28.979210+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:28.979210+0000","last_undegraded":"2024-09-10T11:47:28.979210+0000","last_fullsized":"2024-09-10T11:47:28.979210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729364+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:47:28.729364+0000","last_peered":"2024-09-10T11:47:28.729364+0000","last_clean":"2024-09-10T11:47:28.729364+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:47:28.729364+0000","last_undegraded":"2024-09-10T11:47:28.729364+0000","last_fullsized":"2024-09-10T11:47:28.729364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737923+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:47:28.737923+0000","last_peered":"2024-09-10T11:47:28.737923+0000","last_clean":"2024-09-10T11:47:28.737923+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:47:28.737923+0000","last_undegraded":"2024-09-10T11:47:28.737923+0000","last_fullsized":"2024-09-10T11:47:28.737923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728742+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:47:28.728742+0000","last_peered":"2024-09-10T11:47:28.728742+0000","last_clean":"2024-09-10T11:47:28.728742+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:47:28.728742+0000","last_undegraded":"2024-09-10T11:47:28.728742+0000","last_fullsized":"2024-09-10T11:47:28.728742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027527+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:47:29.027527+0000","last_peered":"2024-09-10T11:47:29.027527+0000","last_clean":"2024-09-10T11:47:29.027527+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:47:29.027527+0000","last_undegraded":"2024-09-10T11:47:29.027527+0000","last_fullsized":"2024-09-10T11:47:29.027527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.959820+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:47:28.959820+0000","last_peered":"2024-09-10T11:47:28.959820+0000","last_clean":"2024-09-10T11:47:28.959820+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:47:28.959820+0000","last_undegraded":"2024-09-10T11:47:28.959820+0000","last_fullsized":"2024-09-10T11:47:28.959820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735428+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:47:28.735428+0000","last_peered":"2024-09-10T11:47:28.735428+0000","last_clean":"2024-09-10T11:47:28.735428+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:47:28.735428+0000","last_undegraded":"2024-09-10T11:47:28.735428+0000","last_fullsized":"2024-09-10T11:47:28.735428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729232+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:47:28.729232+0000","last_peered":"2024-09-10T11:47:28.729232+0000","last_clean":"2024-09-10T11:47:28.729232+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:47:28.729232+0000","last_undegraded":"2024-09-10T11:47:28.729232+0000","last_fullsized":"2024-09-10T11:47:28.729232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026538+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:47:29.026538+0000","last_peered":"2024-09-10T11:47:29.026538+0000","last_clean":"2024-09-10T11:47:29.026538+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:47:29.026538+0000","last_undegraded":"2024-09-10T11:47:29.026538+0000","last_fullsized":"2024-09-10T11:47:29.026538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735750+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:47:28.735750+0000","last_peered":"2024-09-10T11:47:28.735750+0000","last_clean":"2024-09-10T11:47:28.735750+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:47:28.735750+0000","last_undegraded":"2024-09-10T11:47:28.735750+0000","last_fullsized":"2024-09-10T11:47:28.735750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027782+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:47:29.027782+0000","last_peered":"2024-09-10T11:47:29.027782+0000","last_clean":"2024-09-10T11:47:29.027782+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:47:29.027782+0000","last_undegraded":"2024-09-10T11:47:29.027782+0000","last_fullsized":"2024-09-10T11:47:29.027782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729583+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:47:28.729583+0000","last_peered":"2024-09-10T11:47:28.729583+0000","last_clean":"2024-09-10T11:47:28.729583+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:47:28.729583+0000","last_undegraded":"2024-09-10T11:47:28.729583+0000","last_fullsized":"2024-09-10T11:47:28.729583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028075+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:47:29.028075+0000","last_peered":"2024-09-10T11:47:29.028075+0000","last_clean":"2024-09-10T11:47:29.028075+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:47:29.028075+0000","last_undegraded":"2024-09-10T11:47:29.028075+0000","last_fullsized":"2024-09-10T11:47:29.028075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737699+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:47:28.737699+0000","last_peered":"2024-09-10T11:47:28.737699+0000","last_clean":"2024-09-10T11:47:28.737699+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:47:28.737699+0000","last_undegraded":"2024-09-10T11:47:28.737699+0000","last_fullsized":"2024-09-10T11:47:28.737699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737759+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:47:28.737759+0000","last_peered":"2024-09-10T11:47:28.737759+0000","last_clean":"2024-09-10T11:47:28.737759+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:47:28.737759+0000","last_undegraded":"2024-09-10T11:47:28.737759+0000","last_fullsized":"2024-09-10T11:47:28.737759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729656+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:47:28.729656+0000","last_peered":"2024-09-10T11:47:28.729656+0000","last_clean":"2024-09-10T11:47:28.729656+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:47:28.729656+0000","last_undegraded":"2024-09-10T11:47:28.729656+0000","last_fullsized":"2024-09-10T11:47:28.729656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737163+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:47:28.737163+0000","last_peered":"2024-09-10T11:47:28.737163+0000","last_clean":"2024-09-10T11:47:28.737163+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:47:28.737163+0000","last_undegraded":"2024-09-10T11:47:28.737163+0000","last_fullsized":"2024-09-10T11:47:28.737163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.024602+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:47:29.024602+0000","last_peered":"2024-09-10T11:47:29.024602+0000","last_clean":"2024-09-10T11:47:29.024602+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:47:29.024602+0000","last_undegraded":"2024-09-10T11:47:29.024602+0000","last_fullsized":"2024-09-10T11:47:29.024602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728601+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:47:28.728601+0000","last_peered":"2024-09-10T11:47:28.728601+0000","last_clean":"2024-09-10T11:47:28.728601+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:47:28.728601+0000","last_undegraded":"2024-09-10T11:47:28.728601+0000","last_fullsized":"2024-09-10T11:47:28.728601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737189+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:47:28.737189+0000","last_peered":"2024-09-10T11:47:28.737189+0000","last_clean":"2024-09-10T11:47:28.737189+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:47:28.737189+0000","last_undegraded":"2024-09-10T11:47:28.737189+0000","last_fullsized":"2024-09-10T11:47:28.737189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736572+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:47:28.736572+0000","last_peered":"2024-09-10T11:47:28.736572+0000","last_clean":"2024-09-10T11:47:28.736572+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:47:28.736572+0000","last_undegraded":"2024-09-10T11:47:28.736572+0000","last_fullsized":"2024-09-10T11:47:28.736572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027901+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:47:29.027901+0000","last_peered":"2024-09-10T11:47:29.027901+0000","last_clean":"2024-09-10T11:47:29.027901+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:47:29.027901+0000","last_undegraded":"2024-09-10T11:47:29.027901+0000","last_fullsized":"2024-09-10T11:47:29.027901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960407+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:47:28.960407+0000","last_peered":"2024-09-10T11:47:28.960407+0000","last_clean":"2024-09-10T11:47:28.960407+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:47:28.960407+0000","last_undegraded":"2024-09-10T11:47:28.960407+0000","last_fullsized":"2024-09-10T11:47:28.960407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729246+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:47:28.729246+0000","last_peered":"2024-09-10T11:47:28.729246+0000","last_clean":"2024-09-10T11:47:28.729246+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:47:28.729246+0000","last_undegraded":"2024-09-10T11:47:28.729246+0000","last_fullsized":"2024-09-10T11:47:28.729246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728919+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:47:28.728919+0000","last_peered":"2024-09-10T11:47:28.728919+0000","last_clean":"2024-09-10T11:47:28.728919+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:47:28.728919+0000","last_undegraded":"2024-09-10T11:47:28.728919+0000","last_fullsized":"2024-09-10T11:47:28.728919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729488+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:47:28.729488+0000","last_peered":"2024-09-10T11:47:28.729488+0000","last_clean":"2024-09-10T11:47:28.729488+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:47:28.729488+0000","last_undegraded":"2024-09-10T11:47:28.729488+0000","last_fullsized":"2024-09-10T11:47:28.729488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025710+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:47:29.025710+0000","last_peered":"2024-09-10T11:47:29.025710+0000","last_clean":"2024-09-10T11:47:29.025710+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:47:29.025710+0000","last_undegraded":"2024-09-10T11:47:29.025710+0000","last_fullsized":"2024-09-10T11:47:29.025710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979544+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:47:28.979544+0000","last_peered":"2024-09-10T11:47:28.979544+0000","last_clean":"2024-09-10T11:47:28.979544+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:47:28.979544+0000","last_undegraded":"2024-09-10T11:47:28.979544+0000","last_fullsized":"2024-09-10T11:47:28.979544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026498+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:47:29.026498+0000","last_peered":"2024-09-10T11:47:29.026498+0000","last_clean":"2024-09-10T11:47:29.026498+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:47:29.026498+0000","last_undegraded":"2024-09-10T11:47:29.026498+0000","last_fullsized":"2024-09-10T11:47:29.026498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736130+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:47:28.736130+0000","last_peered":"2024-09-10T11:47:28.736130+0000","last_clean":"2024-09-10T11:47:28.736130+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:47:28.736130+0000","last_undegraded":"2024-09-10T11:47:28.736130+0000","last_fullsized":"2024-09-10T11:47:28.736130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736743+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:47:28.736743+0000","last_peered":"2024-09-10T11:47:28.736743+0000","last_clean":"2024-09-10T11:47:28.736743+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:47:28.736743+0000","last_undegraded":"2024-09-10T11:47:28.736743+0000","last_fullsized":"2024-09-10T11:47:28.736743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737047+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:47:28.737047+0000","last_peered":"2024-09-10T11:47:28.737047+0000","last_clean":"2024-09-10T11:47:28.737047+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:47:28.737047+0000","last_undegraded":"2024-09-10T11:47:28.737047+0000","last_fullsized":"2024-09-10T11:47:28.737047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737522+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:47:28.737522+0000","last_peered":"2024-09-10T11:47:28.737522+0000","last_clean":"2024-09-10T11:47:28.737522+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:47:28.737522+0000","last_undegraded":"2024-09-10T11:47:28.737522+0000","last_fullsized":"2024-09-10T11:47:28.737522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:35.450 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T11:47:35.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T11:47:35.451 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T11:47:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/449191693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c161470 msgr2=0x7f688c0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 --2- 172.21.15.78:0/449191693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c161470 0x7f688c0b1b70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6888009900 tx=0x7f688801c880 comp rx=0 tx=0).stop 2024-09-10T11:47:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/449191693 shutdown_connections 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 --2- 172.21.15.78:0/449191693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f688c0d1320 0x7f688c0d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 --2- 172.21.15.78:0/449191693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c161470 0x7f688c0b1b70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/449191693 >> 172.21.15.78:0/449191693 conn(0x7f688c0d19a0 msgr2=0x7f688c0d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/449191693 shutdown_connections 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/449191693 wait complete. 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 Processor -- start 2024-09-10T11:47:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- start start 2024-09-10T11:47:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c0d0e30 0x7f688c1fb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f688c0d1320 0x7f688c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 0x7f688c1f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f688c16af20 con 0x7f688c15a900 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f688c16ada0 con 0x7f688c0d0e30 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f688c16b0a0 con 0x7f688c0d1320 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 0x7f688c1f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 0x7f688c1f7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54942/0 (socket says 172.21.15.78:54942) 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 -- 172.21.15.78:0/1909894461 learned_addr learned my addr 172.21.15.78:0/1909894461 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689124d640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f688c0d1320 0x7f688c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6891a4e640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c0d0e30 0x7f688c1fb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 -- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f688c0d1320 msgr2=0x7f688c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f688c0d1320 0x7f688c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 -- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c0d0e30 msgr2=0x7f688c1fb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c0d0e30 0x7f688c1fb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 -- 172.21.15.78:0/1909894461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c159760 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f689224f640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 0x7f688c1f7f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f688400c7a0 tx=0x7f688400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884003b80 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6884003d40 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688400aab0 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c159a40 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.614+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c15a000 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.618+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688c0b0c10 con 0x7f688c15a900 2024-09-10T11:47:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.618+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f688400ac50 con 0x7f688c15a900 2024-09-10T11:47:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.618+0000 7f68827fc640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f687006f710 0x7f6870071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.618+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f688408f630 con 0x7f688c15a900 2024-09-10T11:47:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.618+0000 7f6891a4e640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f687006f710 0x7f6870071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.618+0000 7f6891a4e640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f687006f710 0x7f6870071bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68880af000 tx=0x7f688801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.622+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f688405c600 con 0x7f688c15a900 2024-09-10T11:47:35.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.770+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f688c0d08d0 con 0x7f688c15a900 2024-09-10T11:47:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.770+0000 7f68827fc640 1 -- 172.21.15.78:0/1909894461 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f688405bf00 con 0x7f688c15a900 2024-09-10T11:47:35.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f687006f710 msgr2=0x7f6870071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f687006f710 0x7f6870071bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68880af000 tx=0x7f688801b120 comp rx=0 tx=0).stop 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 msgr2=0x7f688c1f7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 0x7f688c1f7f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f688400c7a0 tx=0x7f688400cc60 comp rx=0 tx=0).stop 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 shutdown_connections 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f687006f710 0x7f6870071bd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688c15a900 0x7f688c1f7f90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f688c0d1320 0x7f688c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 --2- 172.21.15.78:0/1909894461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f688c0d0e30 0x7f688c1fb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 >> 172.21.15.78:0/1909894461 conn(0x7f688c0d19a0 msgr2=0x7f688c157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 shutdown_connections 2024-09-10T11:47:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.774+0000 7f6893cb2640 1 -- 172.21.15.78:0/1909894461 wait complete. 2024-09-10T11:47:35.793 INFO:teuthology.orchestra.run.smithi078.stdout:[{"version":27,"timestamp":"2024-09-10T11:47:15.648300+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5005.446410"}]}] 2024-09-10T11:47:35.793 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T11:47:35.794 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T11:47:35.794 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T11:47:35.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T11:47:35.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3265122534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58161630 msgr2=0x7fcf580d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3265122534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58161630 0x7fcf580d4770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcf580ce260 tx=0x7fcf4c01c890 comp rx=0 tx=0).stop 2024-09-10T11:47:35.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3265122534 shutdown_connections 2024-09-10T11:47:35.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3265122534 >> v2:172.21.15.112:3300/0 conn(0x7fcf580b4a10 0x7fcf580b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3265122534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58161630 0x7fcf580d4770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3265122534 >> 172.21.15.78:0/3265122534 conn(0x7fcf580d3c80 msgr2=0x7fcf580d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:35.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3265122534 shutdown_connections 2024-09-10T11:47:35.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.914+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3265122534 wait complete. 2024-09-10T11:47:35.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 Processor -- start 2024-09-10T11:47:35.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- start start 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 0x7fcf580b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf58161250 0x7fcf580cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58161630 0x7fcf580cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5816ab40 con 0x7fcf580b4a10 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5816acc0 con 0x7fcf58161630 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5816ae40 con 0x7fcf58161250 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 0x7fcf580b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 0x7fcf580b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54962/0 (socket says 172.21.15.78:54962) 2024-09-10T11:47:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 -- 172.21.15.78:0/3861439084 learned_addr learned my addr 172.21.15.78:0/3861439084 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 -- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf58161250 msgr2=0x7fcf580cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf58161250 0x7fcf580cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 -- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58161630 msgr2=0x7fcf580cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58161630 0x7fcf580cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 -- 172.21.15.78:0/3861439084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf580b98c0 con 0x7fcf580b4a10 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 0x7fcf580b6ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c490 tx=0x7fcf48001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48017070 con 0x7fcf580b4a10 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf48003600 con 0x7fcf580b4a10 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf580b9300 con 0x7fcf580b4a10 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48003a90 con 0x7fcf580b4a10 2024-09-10T11:47:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf580b8850 con 0x7fcf580b4a10 2024-09-10T11:47:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf580b8b40 con 0x7fcf580b4a10 2024-09-10T11:47:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.918+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fcf4801a070 con 0x7fcf580b4a10 2024-09-10T11:47:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.922+0000 7fcf3f7fe640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcf4406f710 0x7fcf44071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.922+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf4808eb70 con 0x7fcf580b4a10 2024-09-10T11:47:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.922+0000 7fcf5659c640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcf4406f710 0x7fcf44071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:35.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.922+0000 7fcf5659c640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcf4406f710 0x7fcf44071bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0af000 tx=0x7fcf4c019630 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:35.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:35.926+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fcf4805bb40 con 0x7fcf580b4a10 2024-09-10T11:47:36.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.114+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcf58153250 con 0x7fcf580b4a10 2024-09-10T11:47:36.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.118+0000 7fcf3f7fe640 1 -- 172.21.15.78:0/3861439084 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+180211 (secure 0 0 0) 0x7fcf4805b440 con 0x7fcf580b4a10 2024-09-10T11:47:36.122 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcf4406f710 msgr2=0x7fcf44071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcf4406f710 0x7fcf44071bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0af000 tx=0x7fcf4c019630 comp rx=0 tx=0).stop 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 msgr2=0x7fcf580b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 0x7fcf580b6ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c490 tx=0x7fcf48001e80 comp rx=0 tx=0).stop 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 shutdown_connections 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58161630 0x7fcf580cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcf4406f710 0x7fcf44071bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf58161250 0x7fcf580cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 --2- 172.21.15.78:0/3861439084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580b4a10 0x7fcf580b6ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 >> 172.21.15.78:0/3861439084 conn(0x7fcf580d3c80 msgr2=0x7fcf580b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 shutdown_connections 2024-09-10T11:47:36.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.122+0000 7fcf5d24f640 1 -- 172.21.15.78:0/3861439084 wait complete. 2024-09-10T11:47:36.139 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4120,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":4127887797},{"type":"v1","addr":"172.21.15.112:6801","nonce":4127887797}]},"active_addr":"172.21.15.112:6801/4127887797","active_change":"2024-09-10T11:47:07.225701+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4141,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":false,"error_string":"No module named 'ceph.fs'","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":false,"error_string":"No module named 'ceph.fs'","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1380231444}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1144823317}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1430203346}]}]} 2024-09-10T11:47:36.143 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T11:47:36.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T11:47:36.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:36.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 -- 172.21.15.78:0/1735853096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed1806f870 msgr2=0x7fed1806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 --2- 172.21.15.78:0/1735853096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed1806f870 0x7fed1806fc90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009840 tx=0x7fed0c01c790 comp rx=0 tx=0).stop 2024-09-10T11:47:36.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 -- 172.21.15.78:0/1735853096 shutdown_connections 2024-09-10T11:47:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 --2- 172.21.15.78:0/1735853096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed1806f870 0x7fed1806fc90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 -- 172.21.15.78:0/1735853096 >> 172.21.15.78:0/1735853096 conn(0x7fed180cf7c0 msgr2=0x7fed180cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 -- 172.21.15.78:0/1735853096 shutdown_connections 2024-09-10T11:47:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.250+0000 7fed1e268640 1 -- 172.21.15.78:0/1735853096 wait complete. 2024-09-10T11:47:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 Processor -- start 2024-09-10T11:47:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- start start 2024-09-10T11:47:36.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed1806f870 0x7fed18151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 0x7fed180afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed181582b0 0x7fed18148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed18168f00 con 0x7fed18072010 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed18168d80 con 0x7fed181582b0 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fed18169080 con 0x7fed1806f870 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 0x7fed180afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 0x7fed180afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54976/0 (socket says 172.21.15.78:54976) 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 -- 172.21.15.78:0/101839936 learned_addr learned my addr 172.21.15.78:0/101839936 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1c805640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed181582b0 0x7fed18148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed17fff640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed1806f870 0x7fed18151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 -- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed1806f870 msgr2=0x7fed18151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed1806f870 0x7fed18151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 -- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed181582b0 msgr2=0x7fed18148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed181582b0 0x7fed18148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 -- 172.21.15.78:0/101839936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed181494f0 con 0x7fed18072010 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed177fe640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 0x7fed180afa90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009790 tx=0x7fed0c0a6980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0ac070 con 0x7fed18072010 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed0c0a6e60 con 0x7fed18072010 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed180b01e0 con 0x7fed18072010 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c003860 con 0x7fed18072010 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed180b1e70 con 0x7fed18072010 2024-09-10T11:47:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1806fc90 con 0x7fed18072010 2024-09-10T11:47:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.254+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fed0c0af070 con 0x7fed18072010 2024-09-10T11:47:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.258+0000 7fed14ff9640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fed0406f710 0x7fed04071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.258+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fed0c129d20 con 0x7fed18072010 2024-09-10T11:47:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.258+0000 7fed17fff640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fed0406f710 0x7fed04071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.258+0000 7fed17fff640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fed0406f710 0x7fed04071bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed0800b810 tx=0x7fed08008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.262+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fed0c0b6070 con 0x7fed18072010 2024-09-10T11:47:36.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.406+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed180aee50 con 0x7fed18072010 2024-09-10T11:47:36.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed14ff9640 1 -- 172.21.15.78:0/101839936 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16657 (secure 0 0 0) 0x7fed0c016410 con 0x7fed18072010 2024-09-10T11:47:36.412 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:36.412 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:28.722562+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:47:24.833218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:47:26.032089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fed0406f710 msgr2=0x7fed04071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fed0406f710 0x7fed04071bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed0800b810 tx=0x7fed08008040 comp rx=0 tx=0).stop 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 msgr2=0x7fed180afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 0x7fed180afa90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009790 tx=0x7fed0c0a6980 comp rx=0 tx=0).stop 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 shutdown_connections 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed181582b0 0x7fed18148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fed0406f710 0x7fed04071bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed18072010 0x7fed180afa90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 --2- 172.21.15.78:0/101839936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed1806f870 0x7fed18151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 >> 172.21.15.78:0/101839936 conn(0x7fed180cf7c0 msgr2=0x7fed1815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 shutdown_connections 2024-09-10T11:47:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.410+0000 7fed1e268640 1 -- 172.21.15.78:0/101839936 wait complete. 2024-09-10T11:47:36.430 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T11:47:36.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:47:36.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/4242992278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c806ded0 msgr2=0x7f28c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 --2- 172.21.15.78:0/4242992278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c806ded0 0x7f28c806e320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28c80b2630 tx=0x7f28bc01eff0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/4242992278 shutdown_connections 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 --2- 172.21.15.78:0/4242992278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c806ded0 0x7f28c806e320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 --2- 172.21.15.78:0/4242992278 >> v2:172.21.15.112:3300/0 conn(0x7f28c815f270 0x7f28c815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/4242992278 >> 172.21.15.78:0/4242992278 conn(0x7f28c80cf7c0 msgr2=0x7f28c80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/4242992278 shutdown_connections 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/4242992278 wait complete. 2024-09-10T11:47:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 Processor -- start 2024-09-10T11:47:36.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- start start 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c806ded0 0x7f28c8148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 0x7f28c8154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c815f270 0x7f28c8154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28c80cecc0 con 0x7f28c815bc80 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f28c80ceb40 con 0x7f28c815f270 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f28c80cee40 con 0x7f28c806ded0 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 0x7f28c8154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 0x7f28c8154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55008/0 (socket says 172.21.15.78:55008) 2024-09-10T11:47:36.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 -- 172.21.15.78:0/2195613109 learned_addr learned my addr 172.21.15.78:0/2195613109 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ccee7640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c815f270 0x7f28c8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c7fff640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c806ded0 0x7f28c8148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 -- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c806ded0 msgr2=0x7f28c8148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c806ded0 0x7f28c8148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 -- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c815f270 msgr2=0x7f28c8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c815f270 0x7f28c8154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 -- 172.21.15.78:0/2195613109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c81f27f0 con 0x7f28c815bc80 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ccee7640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c815f270 0x7f28c8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c77fe640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 0x7f28c8154440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f28bc000c10 tx=0x7f28bc0a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b5040 con 0x7f28c815bc80 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28bc0bf070 con 0x7f28c815bc80 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c81f2ad0 con 0x7f28c815bc80 2024-09-10T11:47:36.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b1c50 con 0x7f28c815bc80 2024-09-10T11:47:36.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.554+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c81f3090 con 0x7f28c815bc80 2024-09-10T11:47:36.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.558+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c815d160 con 0x7f28c815bc80 2024-09-10T11:47:36.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.558+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f28bc003600 con 0x7f28c815bc80 2024-09-10T11:47:36.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.558+0000 7f28c4ff9640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28b406f710 0x7f28b4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.558+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f28bc12d250 con 0x7f28c815bc80 2024-09-10T11:47:36.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.558+0000 7f28c7fff640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28b406f710 0x7f28b4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.558+0000 7f28c7fff640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28b406f710 0x7f28b4071bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28b80058d0 tx=0x7f28b8005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.562+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f28bc018b50 con 0x7f28c815bc80 2024-09-10T11:47:36.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.706+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28c8154fe0 con 0x7f28c815bc80 2024-09-10T11:47:36.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28c4ff9640 1 -- 172.21.15.78:0/2195613109 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16657 (secure 0 0 0) 0x7f28bc0fa330 con 0x7f28c815bc80 2024-09-10T11:47:36.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:36.711 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:47:28.722562+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:47:24.833218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:47:26.032089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:47:36.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28b406f710 msgr2=0x7f28b4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28b406f710 0x7f28b4071bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28b80058d0 tx=0x7f28b8005860 comp rx=0 tx=0).stop 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 msgr2=0x7f28c8154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 0x7f28c8154440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f28bc000c10 tx=0x7f28bc0a8ca0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 shutdown_connections 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c815f270 0x7f28c8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28b406f710 0x7f28b4071bd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c815bc80 0x7f28c8154440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 --2- 172.21.15.78:0/2195613109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c806ded0 0x7f28c8148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 >> 172.21.15.78:0/2195613109 conn(0x7f28c80cf7c0 msgr2=0x7f28c815dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 shutdown_connections 2024-09-10T11:47:36.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.710+0000 7f28ce94a640 1 -- 172.21.15.78:0/2195613109 wait complete. 2024-09-10T11:47:36.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T11:47:36.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T11:47:36.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T11:47:36.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T11:47:36.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T11:47:36.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T11:47:36.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T11:47:36.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T11:47:36.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7efc46791640 1 -- 172.21.15.78:0/1070374419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc40154b20 msgr2=0x7efc4015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7efc46791640 1 --2- 172.21.15.78:0/1070374419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc40154b20 0x7efc4015ac30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efc30009900 tx=0x7efc3001c8c0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7efc46791640 1 -- 172.21.15.78:0/1070374419 shutdown_connections 2024-09-10T11:47:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7efc46791640 1 --2- 172.21.15.78:0/1070374419 >> v2:172.21.15.112:3300/0 conn(0x7efc40073e80 0x7efc400d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7efc46791640 1 --2- 172.21.15.78:0/1070374419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc40154b20 0x7efc4015ac30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7efc46791640 1 -- 172.21.15.78:0/1070374419 >> 172.21.15.78:0/1070374419 conn(0x7efc4006da60 msgr2=0x7efc4006de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 -- 172.21.15.78:0/1771992481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc140a50 msgr2=0x7fa2dc0c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 --2- 172.21.15.78:0/1771992481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc140a50 0x7fa2dc0c4d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009900 tx=0x7fa2d801c770 comp rx=0 tx=0).stop 2024-09-10T11:47:36.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 -- 172.21.15.78:0/1771992481 shutdown_connections 2024-09-10T11:47:36.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 --2- 172.21.15.78:0/1771992481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc140a50 0x7fa2dc0c4d20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 --2- 172.21.15.78:0/1771992481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2dc142b50 0x7fa2dc0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 -- 172.21.15.78:0/1771992481 >> 172.21.15.78:0/1771992481 conn(0x7fa2dc0b1570 msgr2=0x7fa2dc0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7f88bce32640 1 -- 172.21.15.78:0/3868447562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b815f080 msgr2=0x7f88b80cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7f88bce32640 1 --2- 172.21.15.78:0/3868447562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b815f080 0x7f88b80cfa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88b8073be0 tx=0x7f88a801c850 comp rx=0 tx=0).stop 2024-09-10T11:47:36.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 -- 172.21.15.78:0/1771992481 shutdown_connections 2024-09-10T11:47:36.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.914+0000 7fa2e2833640 1 -- 172.21.15.78:0/1771992481 wait complete. 2024-09-10T11:47:36.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 -- 172.21.15.78:0/3204900559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac0cf200 msgr2=0x7fa6ac0b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 --2- 172.21.15.78:0/3204900559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac0cf200 0x7fa6ac0b4490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009c80 tx=0x7fa6a401cda0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 -- 172.21.15.78:0/1070374419 shutdown_connections 2024-09-10T11:47:36.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 -- 172.21.15.78:0/3204900559 shutdown_connections 2024-09-10T11:47:36.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 --2- 172.21.15.78:0/3204900559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac0cf200 0x7fa6ac0b4490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 -- 172.21.15.78:0/3204900559 >> 172.21.15.78:0/3204900559 conn(0x7fa6ac0b1490 msgr2=0x7fa6ac0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 -- 172.21.15.78:0/3868447562 shutdown_connections 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 --2- 172.21.15.78:0/3868447562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b80d0490 0x7f88b80ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 --2- 172.21.15.78:0/3868447562 >> v2:172.21.15.78:3300/0 conn(0x7f88b80b2fe0 0x7f88b80cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 --2- 172.21.15.78:0/3868447562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b815f080 0x7f88b80cfa10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 -- 172.21.15.78:0/3868447562 >> 172.21.15.78:0/3868447562 conn(0x7f88b80d1990 msgr2=0x7f88b80d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 -- 172.21.15.78:0/3868447562 shutdown_connections 2024-09-10T11:47:36.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 -- 172.21.15.78:0/3204900559 shutdown_connections 2024-09-10T11:47:36.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f0bc550d640 1 -- 172.21.15.78:0/2189281263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00cf9a0 msgr2=0x7f0bc0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f0bc550d640 1 --2- 172.21.15.78:0/2189281263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00cf9a0 0x7f0bc0071ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40097c0 tx=0x7f0bb401c650 comp rx=0 tx=0).stop 2024-09-10T11:47:36.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e2833640 1 Processor -- start 2024-09-10T11:47:36.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e2833640 1 -- start start 2024-09-10T11:47:36.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 -- 172.21.15.78:0/1070374419 wait complete. 2024-09-10T11:47:36.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 Processor -- start 2024-09-10T11:47:36.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 -- 172.21.15.78:0/3868447562 wait complete. 2024-09-10T11:47:36.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 Processor -- start 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e2833640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc140a50 0x7fa2dc13c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e2833640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc141040 0x7fa2dc0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e1831640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc140a50 0x7fa2dc13c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e1831640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc140a50 0x7fa2dc13c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55072/0 (socket says 172.21.15.78:55072) 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e1831640 1 -- 172.21.15.78:0/2098366566 learned_addr learned my addr 172.21.15.78:0/2098366566 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e2833640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2dc142b50 0x7fa2dc0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa2e1030640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc141040 0x7fa2dc0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 -- start start 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc40073e80 0x7efc4014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400cccd0 0x7efc40153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc40154b20 0x7efc40155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc40070030 con 0x7efc400cccd0 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f860f550640 1 -- 172.21.15.78:0/3028097830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86080cc080 msgr2=0x7f86080726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f860f550640 1 --2- 172.21.15.78:0/3028097830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86080cc080 0x7f86080726e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f86080ae5d0 tx=0x7f860001dbe0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efc4006feb0 con 0x7efc40154b20 2024-09-10T11:47:36.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7efc46791640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efc400701b0 con 0x7efc40073e80 2024-09-10T11:47:36.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 -- 172.21.15.78:0/3204900559 wait complete. 2024-09-10T11:47:36.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 Processor -- start 2024-09-10T11:47:36.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7fa6b2227640 1 -- start start 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc142f30 con 0x7fa2dc140a50 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc162370 con 0x7fa2dc141040 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc40073e80 0x7efc4014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc40154b20 0x7efc40155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc40154b20 0x7efc40155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58024/0 (socket says 172.21.15.78:58024) 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 -- 172.21.15.78:0/3754970451 learned_addr learned my addr 172.21.15.78:0/3754970451 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc37fff640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400cccd0 0x7efc40153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6b2227640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6ac0cc3d0 0x7fa6ac0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa2dc1430b0 con 0x7fa2dc142b50 2024-09-10T11:47:36.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6b2227640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac0cc7b0 0x7fa6ac219150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6b2227640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac0cf200 0x7fa6ac219690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6b2227640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac15d2d0 con 0x7fa6ac0cc3d0 2024-09-10T11:47:36.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6b2227640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac15d150 con 0x7fa6ac0cf200 2024-09-10T11:47:36.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6b2227640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac15d450 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f0bc550d640 1 -- 172.21.15.78:0/2189281263 shutdown_connections 2024-09-10T11:47:36.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f0bc550d640 1 --2- 172.21.15.78:0/2189281263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00cf9a0 0x7f0bc0071ea0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f0bc550d640 1 -- 172.21.15.78:0/2189281263 >> 172.21.15.78:0/2189281263 conn(0x7f0bc006cd50 msgr2=0x7f0bc006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 -- 172.21.15.78:0/2189281263 shutdown_connections 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- 172.21.15.78:0/3028097830 shutdown_connections 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 --2- 172.21.15.78:0/3028097830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86080cc080 0x7f86080726e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 --2- 172.21.15.78:0/3028097830 >> v2:172.21.15.78:3300/0 conn(0x7f86080ce210 0x7f86080ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- 172.21.15.78:0/3028097830 >> 172.21.15.78:0/3028097830 conn(0x7f86080cfa80 msgr2=0x7f86080cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- 172.21.15.78:0/3028097830 shutdown_connections 2024-09-10T11:47:36.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.918+0000 7f88bce32640 1 -- start start 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88bce32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b80b2fe0 0x7f88b80c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88bce32640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b80d0490 0x7f88b8203b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88bce32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88b815f080 0x7f88b8207890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88bce32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f88b80c5900 con 0x7f88b815f080 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88bce32640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f88b80c5780 con 0x7f88b80b2fe0 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88bce32640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f88b80c5a80 con 0x7f88b80d0490 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2032640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2dc142b50 0x7fa2dc0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- 172.21.15.78:0/3028097830 wait complete. 2024-09-10T11:47:36.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 -- 172.21.15.78:0/2189281263 wait complete. 2024-09-10T11:47:36.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac0cc7b0 0x7fa6ac219150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b80b2fe0 0x7f88b80c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 -- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc40073e80 msgr2=0x7efc4014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc40073e80 0x7efc4014eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 -- 172.21.15.78:0/3754970451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400cccd0 msgr2=0x7efc40153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400cccd0 0x7efc40153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 -- 172.21.15.78:0/3754970451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40146140 con 0x7efc40154b20 2024-09-10T11:47:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac0cc7b0 0x7fa6ac219150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.78:33910/0 (socket says 172.21.15.78:33910) 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 -- 172.21.15.78:0/4241337025 learned_addr learned my addr 172.21.15.78:0/4241337025 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e1831640 1 -- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2dc142b50 msgr2=0x7fa2dc0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e1831640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2dc142b50 0x7fa2dc0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e1831640 1 -- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc141040 msgr2=0x7fa2dc0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e1831640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2dc141040 0x7fa2dc0afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e1831640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc13d130 con 0x7fa2dc140a50 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2032640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2dc142b50 0x7fa2dc0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b80b2fe0 0x7f88b80c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58034/0 (socket says 172.21.15.78:58034) 2024-09-10T11:47:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b5d9b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b80d0490 0x7f88b8203b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 -- 172.21.15.78:0/2764615396 learned_addr learned my addr 172.21.15.78:0/2764615396 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e1831640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc140a50 0x7fa2dc13c8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400ebc0 tx=0x7fa2d400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc44d2e640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc40154b20 0x7efc40155260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc3800ea20 tx=0x7efc3800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6ab7fe640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6ac0cc3d0 0x7fa6ac0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b6d9d640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88b815f080 0x7f88b8207890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 -- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac0cf200 msgr2=0x7fa6ac219690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac0cf200 0x7fa6ac219690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 -- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6ac0cc3d0 msgr2=0x7fa6ac0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6ac0cc3d0 0x7fa6ac0adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 -- 172.21.15.78:0/4241337025 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac161c70 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4010630 con 0x7fa2dc140a50 2024-09-10T11:47:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2d40108c0 con 0x7fa2dc140a50 2024-09-10T11:47:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4010cf0 con 0x7fa2dc140a50 2024-09-10T11:47:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 -- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b80d0490 msgr2=0x7f88b8203b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b80d0490 0x7f88b8203b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 -- 172.21.15.78:0/2764615396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88b815f080 msgr2=0x7f88b8207890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88b815f080 0x7f88b8207890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 -- 172.21.15.78:0/2764615396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b80b4ca0 con 0x7f88b80b2fe0 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2dc13d470 con 0x7fa2dc140a50 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3800cde0 con 0x7efc40154b20 2024-09-10T11:47:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc38004c20 con 0x7efc40154b20 2024-09-10T11:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38005020 con 0x7efc40154b20 2024-09-10T11:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 Processor -- start 2024-09-10T11:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 Processor -- start 2024-09-10T11:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- start start 2024-09-10T11:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f88b659c640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b80b2fe0 0x7f88b80c70b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88a80b0040 tx=0x7f88a80a55e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 -- start start 2024-09-10T11:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa6aaffd640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac0cc7b0 0x7fa6ac219150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4000f90 tx=0x7fa6a40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2dc13dcb0 con 0x7fa2dc140a50 2024-09-10T11:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2dc13d810 con 0x7fa2dc140a50 2024-09-10T11:47:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc0070190 0x7f0bc0141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00b3f60 0x7f0bc01498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bc00cf9a0 0x7f0bc0153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc015ff00 con 0x7f0bc00b3f60 2024-09-10T11:47:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc015fd80 con 0x7f0bc0070190 2024-09-10T11:47:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bc550d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc0160080 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86080caab0 0x7f86080c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86080cc080 0x7f86080c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86080ce210 0x7f86080ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8608166ca0 con 0x7f86080caab0 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8608073540 con 0x7f86080cc080 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860f550640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8608166e20 con 0x7f86080ce210 2024-09-10T11:47:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860daed640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86080ce210 0x7f86080ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860daed640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86080ce210 0x7f86080ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.78:33920/0 (socket says 172.21.15.78:33920) 2024-09-10T11:47:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc46791640 1 -- 172.21.15.78:0/3754970451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc40146420 con 0x7efc40154b20 2024-09-10T11:47:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc46791640 1 -- 172.21.15.78:0/3754970451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401469e0 con 0x7efc40154b20 2024-09-10T11:47:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f860daed640 1 -- 172.21.15.78:0/4169552150 learned_addr learned my addr 172.21.15.78:0/4169552150 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc0070190 0x7f0bc0141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc0070190 0x7f0bc0141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58054/0 (socket says 172.21.15.78:58054) 2024-09-10T11:47:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7f0bbffff640 1 -- 172.21.15.78:0/3898599854 learned_addr learned my addr 172.21.15.78:0/3898599854 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a80b2040 con 0x7f88b80b2fe0 2024-09-10T11:47:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860daed640 1 -- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86080cc080 msgr2=0x7f86080c35b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:47:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860daed640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86080cc080 0x7f86080c35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860daed640 1 -- 172.21.15.78:0/4169552150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86080caab0 msgr2=0x7f86080c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860daed640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86080caab0 0x7f86080c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860daed640 1 -- 172.21.15.78:0/4169552150 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86080880a0 con 0x7f86080ce210 2024-09-10T11:47:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f88bce32640 1 -- 172.21.15.78:0/2764615396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b80b4f80 con 0x7f88b80b2fe0 2024-09-10T11:47:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f88bce32640 1 -- 172.21.15.78:0/2764615396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b80b5540 con 0x7f88b80b2fe0 2024-09-10T11:47:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88a80043b0 con 0x7f88b80b2fe0 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 -- 172.21.15.78:0/4230209896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b0073e80 msgr2=0x7f47b00700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 --2- 172.21.15.78:0/4230209896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b0073e80 0x7f47b00700e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009bc0 tx=0x7f47a801cba0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a40b2040 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6a40044e0 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4004a50 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac161f50 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac162510 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bc00cf9a0 0x7f0bc0153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 -- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc0070190 msgr2=0x7f0bc0141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc0070190 0x7f0bc0141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 -- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00b3f60 msgr2=0x7f0bc01498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bbf7fe640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00b3f60 0x7f0bc01498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00b3f60 0x7f0bc01498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 -- 172.21.15.78:0/3898599854 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc01fb160 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bbf7fe640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc00b3f60 0x7f0bc01498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc4d0c640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bc00cf9a0 0x7f0bc0153870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c890 tx=0x7f0bb800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.922+0000 7efc46791640 1 -- 172.21.15.78:0/3754970451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc24001040 con 0x7efc40154b20 2024-09-10T11:47:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a80052d0 con 0x7f88b80b2fe0 2024-09-10T11:47:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f88bce32640 1 -- 172.21.15.78:0/2764615396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f889c001040 con 0x7f88b80b2fe0 2024-09-10T11:47:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa2d4018420 con 0x7fa2dc140a50 2024-09-10T11:47:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860daed640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86080ce210 0x7f86080ccb50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85f800c3d0 tx=0x7f85f800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 -- 172.21.15.78:0/4230209896 shutdown_connections 2024-09-10T11:47:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 --2- 172.21.15.78:0/4230209896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b0073e80 0x7f47b00700e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 -- 172.21.15.78:0/4230209896 >> 172.21.15.78:0/4230209896 conn(0x7f47b006da60 msgr2=0x7f47b006de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa690001040 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 -- 172.21.15.78:0/4230209896 shutdown_connections 2024-09-10T11:47:36.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8011790 con 0x7f86080ce210 2024-09-10T11:47:36.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86080c3eb0 con 0x7f86080ce210 2024-09-10T11:47:36.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8608145270 con 0x7f86080ce210 2024-09-10T11:47:36.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85f8017070 con 0x7f86080ce210 2024-09-10T11:47:36.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8011ca0 con 0x7f86080ce210 2024-09-10T11:47:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4c2225640 1 -- 172.21.15.78:0/1736037809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4a4007790 msgr2=0x7ff4a4009c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f47b7ec4640 1 -- 172.21.15.78:0/4230209896 wait complete. 2024-09-10T11:47:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2d27fc640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa2c006f710 0x7fa2c0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa2d4091180 con 0x7fa2dc140a50 2024-09-10T11:47:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2d27fc640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fa2c00778b0 0x7fa2c0079cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2d4015e50 con 0x7fa2c00778b0 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa2d40915b0 con 0x7fa2dc140a50 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2e1030640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa2c006f710 0x7fa2c0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4ba7fc640 1 -- 172.21.15.78:0/1736037809 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0006ca0 con 0x7ff4a4007790 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4c2225640 1 --2- 172.21.15.78:0/1736037809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4a4007790 0x7ff4a4009c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c330 tx=0x7ff4b001d0c0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4bbfff640 1 -- 172.21.15.78:0/1736037809 reap_dead start 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4c2225640 1 -- 172.21.15.78:0/1736037809 shutdown_connections 2024-09-10T11:47:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4c2225640 1 -- 172.21.15.78:0/1736037809 >> 172.21.15.78:0/1736037809 conn(0x7ff4bc0b1490 msgr2=0x7ff4bc0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2e2032640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fa2c00778b0 0x7fa2c0079cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7fa2e1030640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa2c006f710 0x7fa2c0071bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc13c6d0 tx=0x7fa2cc00c040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8017070 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bb8005070 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80054a0 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc015b280 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc015b840 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4c2225640 1 -- 172.21.15.78:0/1736037809 shutdown_connections 2024-09-10T11:47:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 Processor -- start 2024-09-10T11:47:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 -- start start 2024-09-10T11:47:36.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bc0071ea0 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86080ce5f0 con 0x7f86080ce210 2024-09-10T11:47:36.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7ff4c2225640 1 -- 172.21.15.78:0/1736037809 wait complete. 2024-09-10T11:47:36.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 Processor -- start 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f88a8005470 con 0x7f88b80b2fe0 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88a6ffd640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f889806f7e0 0x7f8898071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f88a81292b0 con 0x7f88b80b2fe0 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88a6ffd640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f8898077a60 0x7f8898079e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 --> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88a8007e80 con 0x7f8898077a60 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f88a8129650 con 0x7f88b80b2fe0 2024-09-10T11:47:36.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88b6d9d640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f8898077a60 0x7f8898079e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b0073e80 0x7f47b00b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47b0154b20 0x7f47b01fc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015ac30 0x7f47b00b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0168c20 con 0x7f47b0073e80 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0168aa0 con 0x7f47b015ac30 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f47b0168da0 con 0x7f47b0154b20 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b545f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47b0154b20 0x7f47b01fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b545f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47b0154b20 0x7f47b01fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.78:33934/0 (socket says 172.21.15.78:33934) 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b545f640 1 -- 172.21.15.78:0/3000628898 learned_addr learned my addr 172.21.15.78:0/3000628898 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015ac30 0x7f47b00b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 -- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47b0154b20 msgr2=0x7f47b01fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47b0154b20 0x7f47b01fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 -- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b0073e80 msgr2=0x7f47b00b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b0073e80 0x7f47b00b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 -- 172.21.15.78:0/3000628898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b01fc650 con 0x7f47b015ac30 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b6461640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015ac30 0x7f47b00b0ef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ac000 tx=0x7f47a80a5a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80b2040 con 0x7f47b015ac30 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b01fd160 con 0x7f47b015ac30 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b01fce80 con 0x7f47b015ac30 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa6a40be060 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa68c06f7e0 0x7fa68c071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a4129bc0 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7fa68c077a00 0x7fa68c079e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 --> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa68c07a4d0 con 0x7fa68c077a00 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa6a4129f60 con 0x7fa6ac0cc7b0 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6ab7fe640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa68c06f7e0 0x7fa68c071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6abfff640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7fa68c077a00 0x7fa68c079e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6abfff640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7fa68c077a00 0x7fa68c079e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6ab7fe640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa68c06f7e0 0x7fa68c071ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa69c007fd0 tx=0x7fa69c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== osd.1 v2:172.21.15.78:6800/672081061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa68c07a4d0 con 0x7fa68c077a00 2024-09-10T11:47:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f0bb801a070 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa2e2032640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fa2c00778b0 0x7fa2c0079cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== osd.3 v2:172.21.15.78:6808/1722253124 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2d4015e50 con 0x7fa2c00778b0 2024-09-10T11:47:36.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f85f801c460 con 0x7f86080ce210 2024-09-10T11:47:36.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f85fdffb640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f85ec06f710 0x7f85ec071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.926+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7efc380051c0 con 0x7efc40154b20 2024-09-10T11:47:36.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc3d7fa640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efc2006f7e0 0x7efc20071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc38090650 con 0x7efc40154b20 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc3d7fa640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7efc20077a00 0x7efc20079e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 --> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc2007a4d0 con 0x7efc20077a00 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc380909f0 con 0x7efc40154b20 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc37fff640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7efc20077a00 0x7efc20079e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7efc37fff640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7efc20077a00 0x7efc20079e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 -- start start 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4bc1ef7c0 0x7ff4bc1f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4bc14e360 0x7ff4bc1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc155970 0x7ff4bc155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc0b49f0 con 0x7ff4bc155970 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc0b4870 con 0x7ff4bc14e360 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4c2225640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4bc070390 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88b5d9b640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f889806f7e0 0x7f8898071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88b5d9b640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f889806f7e0 0x7f8898071ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f88b8071690 tx=0x7f88ac0090e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7f88b6d9d640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f8898077a60 0x7f8898079e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f860d2ec640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f85ec06f710 0x7f85ec071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4bc1ef7c0 0x7ff4bc1f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4bc1ef7c0 0x7ff4bc1f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.78:33940/0 (socket says 172.21.15.78:33940) 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 -- 172.21.15.78:0/3748193460 learned_addr learned my addr 172.21.15.78:0/3748193460 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 -- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4bc14e360 msgr2=0x7ff4bc1579c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4bc14e360 0x7ff4bc1579c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 -- 172.21.15.78:0/3748193460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc155970 msgr2=0x7ff4bc155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc155970 0x7ff4bc155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.930+0000 7ff4bb7fe640 1 -- 172.21.15.78:0/3748193460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4bc15d0d0 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbcff9640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0bac06f710 0x7f0bac071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7ff4bb7fe640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4bc1ef7c0 0x7ff4bc1f98c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac010a20 tx=0x7ff4ac010ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7efc3ffff640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efc2006f7e0 0x7efc20071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00ece0 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0bb808f6c0 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbcff9640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f0bac077990 0x7f0bac079db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 --> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bac07a460 con 0x7f0bac077990 2024-09-10T11:47:36.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0bb808fa60 con 0x7f0bc00cf9a0 2024-09-10T11:47:36.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ac00ee80 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47b00cccd0 con 0x7f47b015ac30 2024-09-10T11:47:36.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47a8003a40 con 0x7f47b015ac30 2024-09-10T11:47:36.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8004030 con 0x7f47b015ac30 2024-09-10T11:47:36.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbffff640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0bac06f710 0x7f0bac071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f85f80900e0 con 0x7f86080ce210 2024-09-10T11:47:36.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f85fdffb640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f85ec077910 0x7f85ec079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 --> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85f8014e70 con 0x7f85ec077910 2024-09-10T11:47:36.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f85f8090510 con 0x7f86080ce210 2024-09-10T11:47:36.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac01c6c0 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f0bbffff640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0bac06f710 0x7f0bac071bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009600 tx=0x7f0bb401ae90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== osd.5 v2:172.21.15.112:6818/749221931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc2007a4d0 con 0x7efc20077a00 2024-09-10T11:47:36.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.934+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== osd.7 v2:172.21.15.112:6810/485234655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88a8007e80 con 0x7f8898077a60 2024-09-10T11:47:36.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f47a80bd030 con 0x7f47b015ac30 2024-09-10T11:47:36.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f860caeb640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f85ec077910 0x7f85ec079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4bc15cdf0 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4bc154600 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f0bbf7fe640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f0bac077990 0x7f0bac079db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f860d2ec640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f85ec06f710 0x7f85ec071bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86040058d0 tx=0x7f8604005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47a67fc640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f479406f710 0x7f4794071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f47a812a3e0 con 0x7f47b015ac30 2024-09-10T11:47:36.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47a67fc640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f47940778b0 0x7f4794079cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 --> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47a80b1e90 con 0x7f47940778b0 2024-09-10T11:47:36.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7ff4a1ffb640 1 -- 172.21.15.78:0/3748193460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff494001040 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f47a812a810 con 0x7f47b015ac30 2024-09-10T11:47:36.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f860caeb640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f85ec077910 0x7f85ec079d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47b5c60640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f479406f710 0x7f4794071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f0bbf7fe640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f0bac077990 0x7f0bac079db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7efc3ffff640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efc2006f7e0 0x7efc20071ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc300af000 tx=0x7efc3001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f47b5c60640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f479406f710 0x7f4794071bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47b0154500 tx=0x7f47a0006c50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== osd.2 v2:172.21.15.78:6816/3600861345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bac07a460 con 0x7f0bac077990 2024-09-10T11:47:36.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.938+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== osd.4 v2:172.21.15.112:6826/1513593239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85f8014e70 con 0x7f85ec077910 2024-09-10T11:47:36.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.942+0000 7f47b545f640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f47940778b0 0x7f4794079cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.942+0000 7f47b545f640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f47940778b0 0x7f4794079cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.942+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== osd.0 v2:172.21.15.78:6824/1912853801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47a80b1e90 con 0x7f47940778b0 2024-09-10T11:47:36.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.942+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7ff4ac01c860 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.942+0000 7ff4a3fff640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff4a806f710 0x7ff4a8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff4ac090ca0 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4a3fff640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7ff4a80778b0 0x7ff4a8079cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 --> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4ac001d40 con 0x7ff4a80778b0 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff4ac091000 con 0x7ff4bc1ef7c0 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4bbfff640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7ff4a80778b0 0x7ff4a8079cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4baffd640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff4a806f710 0x7ff4a8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4bbfff640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7ff4a80778b0 0x7ff4a8079cd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7ff4baffd640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff4a806f710 0x7ff4a8071bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ac000 tx=0x7ff4b0019e60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.946+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 --> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa690002de0 con 0x7fa68c077a00 2024-09-10T11:47:36.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.950+0000 7fa6a3fff640 1 -- 172.21.15.78:0/4241337025 <== osd.1 v2:172.21.15.78:6800/672081061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa690002de0 con 0x7fa68c077a00 2024-09-10T11:47:36.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.950+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7fa68c077a00 msgr2=0x7fa68c079e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.950+0000 7fa6b2227640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7fa68c077a00 0x7fa68c079e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.954+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 --> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2dc13d810 con 0x7fa2c00778b0 2024-09-10T11:47:36.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.954+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== osd.6 v2:172.21.15.112:6802/2669198428 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4ac001d40 con 0x7ff4a80778b0 2024-09-10T11:47:36.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.954+0000 7fa2d27fc640 1 -- 172.21.15.78:0/2098366566 <== osd.3 v2:172.21.15.78:6808/1722253124 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2d8004220 con 0x7fa2c00778b0 2024-09-10T11:47:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa68c06f7e0 msgr2=0x7fa68c071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa68c06f7e0 0x7fa68c071ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa69c007fd0 tx=0x7fa69c009040 comp rx=0 tx=0).stop 2024-09-10T11:47:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac0cc7b0 msgr2=0x7fa6ac219150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 --2- 172.21.15.78:0/4241337025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac0cc7b0 0x7fa6ac219150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4000f90 tx=0x7fa6a40042f0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fa2c00778b0 msgr2=0x7fa2c0079cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fa2c00778b0 0x7fa2c0079cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa2c006f710 msgr2=0x7fa2c0071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa2c006f710 0x7fa2c0071bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc13c6d0 tx=0x7fa2cc00c040 comp rx=0 tx=0).stop 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc140a50 msgr2=0x7fa2dc13c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 --2- 172.21.15.78:0/2098366566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc140a50 0x7fa2dc13c8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400ebc0 tx=0x7fa2d400c6a0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2032640 1 -- 172.21.15.78:0/2098366566 reap_dead start 2024-09-10T11:47:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6abfff640 1 -- 172.21.15.78:0/4241337025 reap_dead start 2024-09-10T11:47:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 shutdown_connections 2024-09-10T11:47:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 >> 172.21.15.78:0/4241337025 conn(0x7fa6ac0b1490 msgr2=0x7fa6ac154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 shutdown_connections 2024-09-10T11:47:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 >> 172.21.15.78:0/2098366566 conn(0x7fa2dc0b1570 msgr2=0x7fa2dc0af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 shutdown_connections 2024-09-10T11:47:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa2e2833640 1 -- 172.21.15.78:0/2098366566 wait complete. 2024-09-10T11:47:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7efc46791640 1 -- 172.21.15.78:0/3754970451 --> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc24002de0 con 0x7efc20077a00 2024-09-10T11:47:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.958+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 shutdown_connections 2024-09-10T11:47:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7fa6b2227640 1 -- 172.21.15.78:0/4241337025 wait complete. 2024-09-10T11:47:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc3d7fa640 1 -- 172.21.15.78:0/3754970451 <== osd.5 v2:172.21.15.112:6818/749221931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efc24002de0 con 0x7efc20077a00 2024-09-10T11:47:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7efc20077a00 msgr2=0x7efc20079e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7efc20077a00 0x7efc20079e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efc2006f7e0 msgr2=0x7efc20071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efc2006f7e0 0x7efc20071ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc300af000 tx=0x7efc3001b100 comp rx=0 tx=0).stop 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc40154b20 msgr2=0x7efc40155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 --2- 172.21.15.78:0/3754970451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc40154b20 0x7efc40155260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc3800ea20 tx=0x7efc3800eee0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc44d2e640 1 -- 172.21.15.78:0/3754970451 reap_dead start 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 shutdown_connections 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 >> 172.21.15.78:0/3754970451 conn(0x7efc4006da60 msgr2=0x7efc400cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 shutdown_connections 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.962+0000 7efc367fc640 1 -- 172.21.15.78:0/3754970451 wait complete. 2024-09-10T11:47:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 --> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86080ce5f0 con 0x7f85ec077910 2024-09-10T11:47:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 --> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bc0167690 con 0x7f0bac077990 2024-09-10T11:47:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f85fdffb640 1 -- 172.21.15.78:0/4169552150 <== osd.4 v2:172.21.15.112:6826/1513593239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f86080ce5f0 con 0x7f85ec077910 2024-09-10T11:47:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bbcff9640 1 -- 172.21.15.78:0/3898599854 <== osd.2 v2:172.21.15.78:6816/3600861345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0bc0167690 con 0x7f0bac077990 2024-09-10T11:47:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f85ec077910 msgr2=0x7f85ec079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f85ec077910 0x7f85ec079d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f0bac077990 msgr2=0x7f0bac079db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f0bac077990 0x7f0bac079db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0bac06f710 msgr2=0x7f0bac071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0bac06f710 0x7f0bac071bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009600 tx=0x7f0bb401ae90 comp rx=0 tx=0).stop 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bc00cf9a0 msgr2=0x7f0bc0153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 --2- 172.21.15.78:0/3898599854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bc00cf9a0 0x7f0bc0153870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c890 tx=0x7f0bb800cd50 comp rx=0 tx=0).stop 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f85ec06f710 msgr2=0x7f85ec071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f85ec06f710 0x7f85ec071bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86040058d0 tx=0x7f8604005860 comp rx=0 tx=0).stop 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86080ce210 msgr2=0x7f86080ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 --2- 172.21.15.78:0/4169552150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86080ce210 0x7f86080ccb50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85f800c3d0 tx=0x7f85f800c890 comp rx=0 tx=0).stop 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860daed640 1 -- 172.21.15.78:0/4169552150 reap_dead start 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 shutdown_connections 2024-09-10T11:47:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 >> 172.21.15.78:0/4169552150 conn(0x7f86080cfa80 msgr2=0x7f8608072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc4d0c640 1 -- 172.21.15.78:0/3898599854 reap_dead start 2024-09-10T11:47:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 shutdown_connections 2024-09-10T11:47:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 >> 172.21.15.78:0/3898599854 conn(0x7f0bc006cd50 msgr2=0x7f0bc0148f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 shutdown_connections 2024-09-10T11:47:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 shutdown_connections 2024-09-10T11:47:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f860f550640 1 -- 172.21.15.78:0/4169552150 wait complete. 2024-09-10T11:47:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.966+0000 7f0bc550d640 1 -- 172.21.15.78:0/3898599854 wait complete. 2024-09-10T11:47:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 --> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47b00b1680 con 0x7f47940778b0 2024-09-10T11:47:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f88bce32640 1 -- 172.21.15.78:0/2764615396 --> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f889c002d60 con 0x7f8898077a60 2024-09-10T11:47:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47a67fc640 1 -- 172.21.15.78:0/3000628898 <== osd.0 v2:172.21.15.78:6824/1912853801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f47b00b1680 con 0x7f47940778b0 2024-09-10T11:47:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f47940778b0 msgr2=0x7f4794079cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f47940778b0 0x7f4794079cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f88a6ffd640 1 -- 172.21.15.78:0/2764615396 <== osd.7 v2:172.21.15.112:6810/485234655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f889c002d60 con 0x7f8898077a60 2024-09-10T11:47:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f479406f710 msgr2=0x7f4794071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f479406f710 0x7f4794071bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47b0154500 tx=0x7f47a0006c50 comp rx=0 tx=0).stop 2024-09-10T11:47:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015ac30 msgr2=0x7f47b00b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b7ec4640 1 --2- 172.21.15.78:0/3000628898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015ac30 0x7f47b00b0ef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ac000 tx=0x7f47a80a5a40 comp rx=0 tx=0).stop 2024-09-10T11:47:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.970+0000 7f47b6461640 1 -- 172.21.15.78:0/3000628898 reap_dead start 2024-09-10T11:47:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.974+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 shutdown_connections 2024-09-10T11:47:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.974+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 >> 172.21.15.78:0/3000628898 conn(0x7f47b006da60 msgr2=0x7f47b014a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.974+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 shutdown_connections 2024-09-10T11:47:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.974+0000 7f47b7ec4640 1 -- 172.21.15.78:0/3000628898 wait complete. 2024-09-10T11:47:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7ff4a1ffb640 1 -- 172.21.15.78:0/3748193460 --> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff494002de0 con 0x7ff4a80778b0 2024-09-10T11:47:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f8898077a60 msgr2=0x7f8898079e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f8898077a60 0x7f8898079e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f889806f7e0 msgr2=0x7f8898071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f889806f7e0 0x7f8898071ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f88b8071690 tx=0x7f88ac0090e0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b80b2fe0 msgr2=0x7f88b80c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 --2- 172.21.15.78:0/2764615396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b80b2fe0 0x7f88b80c70b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88a80b0040 tx=0x7f88a80a55e0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88b6d9d640 1 -- 172.21.15.78:0/2764615396 reap_dead start 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 shutdown_connections 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 >> 172.21.15.78:0/2764615396 conn(0x7f88b80d1990 msgr2=0x7f88b80cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 shutdown_connections 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7f88a4ff9640 1 -- 172.21.15.78:0/2764615396 wait complete. 2024-09-10T11:47:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.978+0000 7ff4a3fff640 1 -- 172.21.15.78:0/3748193460 <== osd.6 v2:172.21.15.112:6802/2669198428 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff494002de0 con 0x7ff4a80778b0 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7ff4a80778b0 msgr2=0x7ff4a8079cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7ff4a80778b0 0x7ff4a8079cd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff4a806f710 msgr2=0x7ff4a8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff4a806f710 0x7ff4a8071bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ac000 tx=0x7ff4b0019e60 comp rx=0 tx=0).stop 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4bc1ef7c0 msgr2=0x7ff4bc1f98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 --2- 172.21.15.78:0/3748193460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4bc1ef7c0 0x7ff4bc1f98c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac010a20 tx=0x7ff4ac010ee0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4bbfff640 1 -- 172.21.15.78:0/3748193460 reap_dead start 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 shutdown_connections 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.982+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 >> 172.21.15.78:0/3748193460 conn(0x7ff4bc0b1490 msgr2=0x7ff4bc0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.986+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 shutdown_connections 2024-09-10T11:47:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:36.986+0000 7ff4c2225640 1 -- 172.21.15.78:0/3748193460 wait complete. 2024-09-10T11:47:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:64424509449 2024-09-10T11:47:37.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T11:47:37.001 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T11:47:37.002 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T11:47:37.003 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T11:47:37.005 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T11:47:37.008 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T11:47:37.012 INFO:teuthology.orchestra.run.smithi078.stdout:64424509449 2024-09-10T11:47:37.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T11:47:37.016 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2024-09-10T11:47:37.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T11:47:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 -- 172.21.15.78:0/3266032615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e815ada0 msgr2=0x7f98e80c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 --2- 172.21.15.78:0/3266032615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e815ada0 0x7f98e80c47e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f98e000ad90 tx=0x7f98e001dca0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 -- 172.21.15.78:0/3266032615 shutdown_connections 2024-09-10T11:47:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 --2- 172.21.15.78:0/3266032615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e815ada0 0x7f98e80c47e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 --2- 172.21.15.78:0/3266032615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 0x7f98e806e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 -- 172.21.15.78:0/3266032615 >> 172.21.15.78:0/3266032615 conn(0x7f98e80b1570 msgr2=0x7f98e80b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 -- 172.21.15.78:0/3266032615 shutdown_connections 2024-09-10T11:47:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f98ee88e640 1 -- 172.21.15.78:0/3266032615 wait complete. 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f2f64c9e640 1 -- 172.21.15.78:0/1887198131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 msgr2=0x7f2f6006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f2f64c9e640 1 --2- 172.21.15.78:0/1887198131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f6006e0e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006d4f0 tx=0x7f2f5802ddc0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f2f64c9e640 1 -- 172.21.15.78:0/1887198131 shutdown_connections 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f2f64c9e640 1 --2- 172.21.15.78:0/1887198131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f600cf330 0x7f2f60161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f2f64c9e640 1 --2- 172.21.15.78:0/1887198131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f6006e0e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.162+0000 7f2f64c9e640 1 -- 172.21.15.78:0/1887198131 >> 172.21.15.78:0/1887198131 conn(0x7f2f60068cc0 msgr2=0x7f2f6006c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 Processor -- start 2024-09-10T11:47:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 -- start start 2024-09-10T11:47:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 0x7f98e81f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 0x7f98e8151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 0x7f98e8151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 0x7f98e8151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55180/0 (socket says 172.21.15.78:55180) 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e815ada0 0x7f98e8152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 -- 172.21.15.78:0/48279901 learned_addr learned my addr 172.21.15.78:0/48279901 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f98e80c5300 con 0x7f98e81543d0 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98e80c5180 con 0x7f98e815ada0 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98e80c5480 con 0x7f98e80cdc00 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed88c640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 0x7f98e81f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 -- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 msgr2=0x7f98e81f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 0x7f98e81f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 -- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e815ada0 msgr2=0x7f98e8152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e815ada0 0x7f98e8152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e81f6470 con 0x7f98e81543d0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed88c640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 0x7f98e81f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ed08b640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 0x7f98e8151b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98d800d980 tx=0x7f98d800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d8017070 con 0x7f98e81543d0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e80c6b90 con 0x7f98e81543d0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e80c7150 con 0x7f98e81543d0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98d8009d20 con 0x7f98e81543d0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.166+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d80106c0 con 0x7f98e81543d0 2024-09-10T11:47:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f98d801a070 con 0x7f98e81543d0 2024-09-10T11:47:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc0052a0 con 0x7f98e81543d0 2024-09-10T11:47:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f98de7fc640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f98d406f870 0x7f98d4071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f98d808ff00 con 0x7f98e81543d0 2024-09-10T11:47:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f98ed88c640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f98d406f870 0x7f98d4071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f98ed88c640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f98d406f870 0x7f98d4071d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98e4000f70 tx=0x7f98e4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 -- 172.21.15.78:0/1887198131 shutdown_connections 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 -- 172.21.15.78:0/1887198131 wait complete. 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 Processor -- start 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 -- start start 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f601489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f600727f0 0x7f2f6014abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f600cf330 0x7f2f601340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2f600b3610 con 0x7f2f60072410 2024-09-10T11:47:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f600b3490 con 0x7f2f600cf330 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.170+0000 7f2f64c9e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2f600b3790 con 0x7f2f600727f0 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f601489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f601489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55186/0 (socket says 172.21.15.78:55186) 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 -- 172.21.15.78:0/3239395297 learned_addr learned my addr 172.21.15.78:0/3239395297 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 -- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f600727f0 msgr2=0x7f2f6014abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f600727f0 0x7f2f6014abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 -- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f600cf330 msgr2=0x7f2f601340d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f600cf330 0x7f2f601340d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 -- 172.21.15.78:0/3239395297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6014b680 con 0x7f2f60072410 2024-09-10T11:47:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f5e59c640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f601489d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f5802dbf0 tx=0x7f2f580b6cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f98d805cda0 con 0x7f98e81543d0 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f580bfa90 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.174+0000 7f2f64c9e640 1 -- 172.21.15.78:0/3239395297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6014b960 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f64c9e640 1 -- 172.21.15.78:0/3239395297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6014bf20 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f580bfc30 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f580c3060 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f2f58005040 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f64c9e640 1 -- 172.21.15.78:0/3239395297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f440052a0 con 0x7f2f60072410 2024-09-10T11:47:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f4effd640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2f4006f710 0x7f2f40071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.178+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2f5812a110 con 0x7f2f60072410 2024-09-10T11:47:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.182+0000 7f2f5dd9b640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2f4006f710 0x7f2f40071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.182+0000 7f2f5dd9b640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2f4006f710 0x7f2f40071bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f6014fd80 tx=0x7f2f540079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f2f580279e0 con 0x7f2f60072410 2024-09-10T11:47:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 -- 172.21.15.78:0/3498873528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 msgr2=0x7f1f8c005a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 --2- 172.21.15.78:0/3498873528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 0x7f1f8c005a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c050f10 tx=0x7f1f8801f0b0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 -- 172.21.15.78:0/3498873528 shutdown_connections 2024-09-10T11:47:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 --2- 172.21.15.78:0/3498873528 >> v2:172.21.15.112:3300/0 conn(0x7f1f8c005f50 0x7f1f8c0de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 --2- 172.21.15.78:0/3498873528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 0x7f1f8c005a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 --2- 172.21.15.78:0/3498873528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c053ef0 0x7f1f8c0e30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 -- 172.21.15.78:0/3498873528 >> 172.21.15.78:0/3498873528 conn(0x7f1f8c01d780 msgr2=0x7f1f8c054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 -- 172.21.15.78:0/3498873528 shutdown_connections 2024-09-10T11:47:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.186+0000 7f1f998a2640 1 -- 172.21.15.78:0/3498873528 wait complete. 2024-09-10T11:47:37.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 Processor -- start 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 -- 172.21.15.78:0/3647725330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f336815a930 msgr2=0x7f336806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 --2- 172.21.15.78:0/3647725330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f336815a930 0x7f336806fcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3358009900 tx=0x7f335801c790 comp rx=0 tx=0).stop 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 -- 172.21.15.78:0/3647725330 shutdown_connections 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 --2- 172.21.15.78:0/3647725330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33680cf260 0x7f3368070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 --2- 172.21.15.78:0/3647725330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f336815a930 0x7f336806fcd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 -- 172.21.15.78:0/3647725330 >> 172.21.15.78:0/3647725330 conn(0x7f336806e9b0 msgr2=0x7f336806edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 -- 172.21.15.78:0/3647725330 shutdown_connections 2024-09-10T11:47:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 -- 172.21.15.78:0/3647725330 wait complete. 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 -- start start 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c005f50 0x7f1f8c0dba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 0x7f1f8c04d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c053ef0 0x7f1f8c04a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f92ffd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c005f50 0x7f1f8c0dba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f92ffd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c005f50 0x7f1f8c0dba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.78:34018/0 (socket says 172.21.15.78:34018) 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f92ffd640 1 -- 172.21.15.78:0/2480075953 learned_addr learned my addr 172.21.15.78:0/2480075953 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c054e00 con 0x7f1f8c006ff0 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c054c80 con 0x7f1f8c053ef0 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c0de700 con 0x7f1f8c005f50 2024-09-10T11:47:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f1f937fe640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c053ef0 0x7f1f8c04a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 Processor -- start 2024-09-10T11:47:37.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.190+0000 7f336f694640 1 -- start start 2024-09-10T11:47:37.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f1f937fe640 1 -- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c005f50 msgr2=0x7f1f8c0dba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f1f937fe640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c005f50 0x7f1f8c0dba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f1f937fe640 1 -- 172.21.15.78:0/2480075953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 msgr2=0x7f1f8c04d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f1f937fe640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 0x7f1f8c04d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f1f937fe640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c1812c0 con 0x7f1f8c053ef0 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f1f937fe640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c053ef0 0x7f1f8c04a0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f9406b290 tx=0x7f1f94069aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/768278636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c00a480 msgr2=0x7f0b3c00a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 --2- 172.21.15.78:0/768278636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c00a480 0x7f0b3c00a860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d330 tx=0x7f0b3801d950 comp rx=0 tx=0).stop 2024-09-10T11:47:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 0x7f336814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/768278636 shutdown_connections 2024-09-10T11:47:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 --2- 172.21.15.78:0/768278636 >> v2:172.21.15.78:3300/0 conn(0x7f0b3c036700 0x7f0b3c0060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 --2- 172.21.15.78:0/768278636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c00a480 0x7f0b3c00a860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/768278636 >> 172.21.15.78:0/768278636 conn(0x7f0b3c054570 msgr2=0x7f0b3c054980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f336815a550 0x7f33680ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3368150ff0 0x7f336815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/768278636 shutdown_connections 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33681675b0 con 0x7f33680cf260 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 0x7f336814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3368167430 con 0x7f3368150ff0 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3368167730 con 0x7f336815a550 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 0x7f336814db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55216/0 (socket says 172.21.15.78:55216) 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 -- 172.21.15.78:0/3221312475 learned_addr learned my addr 172.21.15.78:0/3221312475 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336dc31640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3368150ff0 0x7f336815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336cc2f640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f336815a550 0x7f33680ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 -- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f336815a550 msgr2=0x7f33680ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f336815a550 0x7f33680ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 -- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3368150ff0 msgr2=0x7f336815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3368150ff0 0x7f336815d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 -- 172.21.15.78:0/3221312475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33680b30f0 con 0x7f33680cf260 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336d430640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 0x7f336814db90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f336400b4a0 tx=0x7f336400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364014070 con 0x7f33680cf260 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3364010700 con 0x7f33680cf260 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364010b90 con 0x7f33680cf260 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33680b33d0 con 0x7f33680cf260 2024-09-10T11:47:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33680b3990 con 0x7f33680cf260 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/768278636 wait complete. 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 Processor -- start 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f0b4a1a8640 1 -- start start 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b4a1a8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b3c00a480 0x7f0b3c045c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b4a1a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c01c370 0x7f0b3c0d90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b4a1a8640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b3c036700 0x7f0b3c0d9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b4a1a8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c038740 con 0x7f0b3c00a480 2024-09-10T11:47:37.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b4a1a8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c0385c0 con 0x7f0b3c01c370 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b4a1a8640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c0388c0 con 0x7f0b3c036700 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b3c00a480 0x7f0b3c045c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b3c00a480 0x7f0b3c045c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55220/0 (socket says 172.21.15.78:55220) 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b437fe640 1 -- 172.21.15.78:0/1100186043 learned_addr learned my addr 172.21.15.78:0/1100186043 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b3c036700 0x7f0b3c0d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b42ffd640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c01c370 0x7f0b3c0d90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.194+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3368070bc0 con 0x7f33680cf260 2024-09-10T11:47:37.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f3364017070 con 0x7f33680cf260 2024-09-10T11:47:37.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f335dffb640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f335406f850 0x7f3354071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f336408f3c0 con 0x7f33680cf260 2024-09-10T11:47:37.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f336cc2f640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f335406f850 0x7f3354071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 -- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c01c370 msgr2=0x7f0b3c0d90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c01c370 0x7f0b3c0d90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 -- 172.21.15.78:0/1100186043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b3c00a480 msgr2=0x7f0b3c045c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b3c00a480 0x7f0b3c045c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 -- 172.21.15.78:0/1100186043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c0d6960 con 0x7f0b3c036700 2024-09-10T11:47:37.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f0b43fff640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b3c036700 0x7f0b3c0d9630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b4406bff0 tx=0x7f0b44069bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.198+0000 7f336cc2f640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f335406f850 0x7f3354071d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33580af000 tx=0x7f335801afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.206+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f336405c260 con 0x7f33680cf260 2024-09-10T11:47:37.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.206+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4406dc30 con 0x7f0b3c036700 2024-09-10T11:47:37.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.206+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/1100186043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c0d5e80 con 0x7f0b3c036700 2024-09-10T11:47:37.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.206+0000 7f0b4a1a8640 1 -- 172.21.15.78:0/1100186043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c0d6580 con 0x7f0b3c036700 2024-09-10T11:47:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.206+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94090070 con 0x7f1f8c053ef0 2024-09-10T11:47:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.206+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f9406cdd0 con 0x7f1f8c053ef0 2024-09-10T11:47:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b44094420 con 0x7f0b3c036700 2024-09-10T11:47:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94094660 con 0x7f1f8c053ef0 2024-09-10T11:47:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c1815a0 con 0x7f1f8c053ef0 2024-09-10T11:47:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c181b60 con 0x7f1f8c053ef0 2024-09-10T11:47:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44094930 con 0x7f0b3c036700 2024-09-10T11:47:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f0b44094b90 con 0x7f0b3c036700 2024-09-10T11:47:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f0b2ffff640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b2806f7e0 0x7f0b28071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b44109e20 con 0x7f0b3c036700 2024-09-10T11:47:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f0b437fe640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b2806f7e0 0x7f0b28071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.210+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1f9409b060 con 0x7f1f8c053ef0 2024-09-10T11:47:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f0b437fe640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b2806f7e0 0x7f0b28071ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b3801b580 tx=0x7f0b380a8040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f1f7bfff640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f8006f790 0x7f1f80071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1f9410ab00 con 0x7f1f8c053ef0 2024-09-10T11:47:37.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f1f92ffd640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f8006f790 0x7f1f80071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f1f92ffd640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f8006f790 0x7f1f80071c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c055450 tx=0x7f1f8400d040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b240052a0 con 0x7f0b3c036700 2024-09-10T11:47:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.214+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8c005a10 con 0x7f1f8c053ef0 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- 172.21.15.78:0/2412966024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 msgr2=0x7f63880caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 --2- 172.21.15.78:0/2412966024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880caba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6380009c80 tx=0x7f638001cda0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- 172.21.15.78:0/2412966024 shutdown_connections 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 --2- 172.21.15.78:0/2412966024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880caba0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 --2- 172.21.15.78:0/2412966024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f638815a500 0x7f638815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- 172.21.15.78:0/2412966024 >> 172.21.15.78:0/2412966024 conn(0x7f638806e9b0 msgr2=0x7f638806edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- 172.21.15.78:0/2412966024 shutdown_connections 2024-09-10T11:47:37.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- 172.21.15.78:0/2412966024 wait complete. 2024-09-10T11:47:37.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 Processor -- start 2024-09-10T11:47:37.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- start start 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6388157a70 0x7f63881484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815a500 0x7f638814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6388070fa0 con 0x7f63880ca6f0 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6388070e20 con 0x7f638815a500 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f638db47640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6388071120 con 0x7f6388157a70 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55260/0 (socket says 172.21.15.78:55260) 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 -- 172.21.15.78:0/3695714192 learned_addr learned my addr 172.21.15.78:0/3695714192 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f6387fff640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815a500 0x7f638814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f6386ffd640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6388157a70 0x7f63881484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 -- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6388157a70 msgr2=0x7f63881484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6388157a70 0x7f63881484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 -- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815a500 msgr2=0x7f638814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815a500 0x7f638814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 -- 172.21.15.78:0/3695714192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638814ffb0 con 0x7f63880ca6f0 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f6387fff640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815a500 0x7f638814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f63877fe640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880b1600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f637800c480 tx=0x7f637800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.226+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0b3c0d6960 con 0x7f0b3c036700 2024-09-10T11:47:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- 172.21.15.78:0/3550274124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 msgr2=0x7f315c0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 --2- 172.21.15.78:0/3550274124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 0x7f315c0cc570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3154009bc0 tx=0x7f315401c990 comp rx=0 tx=0).stop 2024-09-10T11:47:37.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1f940d7ab0 con 0x7f1f8c053ef0 2024-09-10T11:47:37.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- 172.21.15.78:0/3550274124 shutdown_connections 2024-09-10T11:47:37.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 --2- 172.21.15.78:0/3550274124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 0x7f315c0cc570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 --2- 172.21.15.78:0/3550274124 >> v2:172.21.15.78:3300/0 conn(0x7f315c15d9e0 0x7f315c162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- 172.21.15.78:0/3550274124 >> 172.21.15.78:0/3550274124 conn(0x7f315c0b1490 msgr2=0x7f315c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- 172.21.15.78:0/3550274124 shutdown_connections 2024-09-10T11:47:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- 172.21.15.78:0/3550274124 wait complete. 2024-09-10T11:47:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 Processor -- start 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 -- 172.21.15.78:0/3465760393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641415ac30 msgr2=0x7f6414073770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 --2- 172.21.15.78:0/3465760393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641415ac30 0x7f6414073770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6408009900 tx=0x7f640801c8e0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 -- 172.21.15.78:0/3465760393 shutdown_connections 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 --2- 172.21.15.78:0/3465760393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6414073cb0 0x7f64140d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 --2- 172.21.15.78:0/3465760393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641415ac30 0x7f6414073770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 -- 172.21.15.78:0/3465760393 >> 172.21.15.78:0/3465760393 conn(0x7f641406da60 msgr2=0x7f641406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 -- 172.21.15.78:0/3465760393 shutdown_connections 2024-09-10T11:47:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f641a432640 1 -- 172.21.15.78:0/3465760393 wait complete. 2024-09-10T11:47:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- start start 2024-09-10T11:47:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 0x7f315c15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 0x7f315c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c15ddc0 0x7f315c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f315c16aa90 con 0x7f315c15d9e0 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f315c16a910 con 0x7f315c15ddc0 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f31629f6640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f315c16ac10 con 0x7f315c0cc110 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f3153fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 0x7f315c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f3153fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 0x7f315c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55276/0 (socket says 172.21.15.78:55276) 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f3153fff640 1 -- 172.21.15.78:0/2220607198 learned_addr learned my addr 172.21.15.78:0/2220607198 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f3160f93640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c15ddc0 0x7f315c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.230+0000 7f315bfff640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 0x7f315c15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f3153fff640 1 -- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 msgr2=0x7f315c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f3153fff640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 0x7f315c15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f3153fff640 1 -- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c15ddc0 msgr2=0x7f315c15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f3153fff640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c15ddc0 0x7f315c15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f3153fff640 1 -- 172.21.15.78:0/2220607198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c2050f0 con 0x7f315c15d9e0 2024-09-10T11:47:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f3153fff640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 0x7f315c156bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c760 tx=0x7f314c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c017070 con 0x7f315c15d9e0 2024-09-10T11:47:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f314c005360 con 0x7f315c15d9e0 2024-09-10T11:47:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c003860 con 0x7f315c15d9e0 2024-09-10T11:47:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 Processor -- start 2024-09-10T11:47:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 -- start start 2024-09-10T11:47:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c159eb0 con 0x7f315c15d9e0 2024-09-10T11:47:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c15a470 con 0x7f315c15d9e0 2024-09-10T11:47:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c0cc570 con 0x7f315c15d9e0 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6414073cb0 0x7f6414142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6414154b20 0x7f6414156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 0x7f6414156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f641406f0d0 con 0x7f6414073cb0 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f641406d780 con 0x7f64141430b0 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f641a432640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f641406f250 con 0x7f6414154b20 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f64189cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 0x7f6414156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f64137fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6414154b20 0x7f6414156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f64189cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 0x7f6414156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58148/0 (socket says 172.21.15.78:58148) 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.234+0000 7f64189cf640 1 -- 172.21.15.78:0/2965951290 learned_addr learned my addr 172.21.15.78:0/2965951290 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f64189cf640 1 -- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6414154b20 msgr2=0x7f6414156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f64189cf640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6414154b20 0x7f6414156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f64189cf640 1 -- 172.21.15.78:0/2965951290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6414073cb0 msgr2=0x7f6414142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f64189cf640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6414073cb0 0x7f6414142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f64189cf640 1 -- 172.21.15.78:0/2965951290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64141679b0 con 0x7f64141430b0 2024-09-10T11:47:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f64189cf640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 0x7f6414156bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f640c00eb20 tx=0x7f640c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f314c01a070 con 0x7f315c15d9e0 2024-09-10T11:47:37.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f31597fa640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f313c06f710 0x7f313c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f314c08f0d0 con 0x7f315c15d9e0 2024-09-10T11:47:37.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f315bfff640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f313c06f710 0x7f313c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c004b30 con 0x7f64141430b0 2024-09-10T11:47:37.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64141547b0 con 0x7f64141430b0 2024-09-10T11:47:37.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6414167f30 con 0x7f64141430b0 2024-09-10T11:47:37.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f315bfff640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f313c06f710 0x7f313c071bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f315c160250 tx=0x7f3144009260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f640c004cf0 con 0x7f64141430b0 2024-09-10T11:47:37.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c005280 con 0x7f64141430b0 2024-09-10T11:47:37.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.238+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6414073770 con 0x7f64141430b0 2024-09-10T11:47:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378012830 con 0x7f63880ca6f0 2024-09-10T11:47:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6378017070 con 0x7f63880ca6f0 2024-09-10T11:47:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378012d80 con 0x7f63880ca6f0 2024-09-10T11:47:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63881503c0 con 0x7f63880ca6f0 2024-09-10T11:47:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638814f550 con 0x7f63880ca6f0 2024-09-10T11:47:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f640c005420 con 0x7f64141430b0 2024-09-10T11:47:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f6410ff9640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f640006f760 0x7f6400071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f640c0903a0 con 0x7f64141430b0 2024-09-10T11:47:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638814f750 con 0x7f63880ca6f0 2024-09-10T11:47:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f6413fff640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f640006f760 0x7f6400071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f6413fff640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f640006f760 0x7f6400071c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6404000f70 tx=0x7f64040079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.242+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f314c021020 con 0x7f315c15d9e0 2024-09-10T11:47:37.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.250+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f637801c460 con 0x7f63880ca6f0 2024-09-10T11:47:37.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.250+0000 7f636ffff640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f637406f710 0x7f6374071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.250+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f637808fd20 con 0x7f63880ca6f0 2024-09-10T11:47:37.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.250+0000 7f6386ffd640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f637406f710 0x7f6374071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.250+0000 7f6386ffd640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f637406f710 0x7f6374071bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63880cf460 tx=0x7f637c005c10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.254+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f640c05d350 con 0x7f64141430b0 2024-09-10T11:47:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.258+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f638814f750 con 0x7f63880ca6f0 2024-09-10T11:47:37.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.462+0000 7f2f64c9e640 1 -- 172.21.15.78:0/3239395297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2f44005590 con 0x7f2f60072410 2024-09-10T11:47:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.462+0000 7f2f4effd640 1 -- 172.21.15.78:0/3239395297 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f580f7060 con 0x7f2f60072410 2024-09-10T11:47:37.464 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 -- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2f4006f710 msgr2=0x7f2f40071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2f4006f710 0x7f2f40071bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f6014fd80 tx=0x7f2f540079c0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 -- 172.21.15.78:0/3239395297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 msgr2=0x7f2f601489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f601489d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f5802dbf0 tx=0x7f2f580b6cb0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 -- 172.21.15.78:0/3239395297 shutdown_connections 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f600cf330 0x7f2f601340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2f4006f710 0x7f2f40071bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f600727f0 0x7f2f6014abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 --2- 172.21.15.78:0/3239395297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f60072410 0x7f2f601489d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 -- 172.21.15.78:0/3239395297 >> 172.21.15.78:0/3239395297 conn(0x7f2f60068cc0 msgr2=0x7f2f600b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 -- 172.21.15.78:0/3239395297 shutdown_connections 2024-09-10T11:47:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.470+0000 7f2f4cff9640 1 -- 172.21.15.78:0/3239395297 wait complete. 2024-09-10T11:47:37.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.474+0000 7f98ee88e640 1 -- 172.21.15.78:0/48279901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f98cc005590 con 0x7f98e81543d0 2024-09-10T11:47:37.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.474+0000 7f98de7fc640 1 -- 172.21.15.78:0/48279901 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98d805c6a0 con 0x7f98e81543d0 2024-09-10T11:47:37.478 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 -- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f98d406f870 msgr2=0x7f98d4071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f98d406f870 0x7f98d4071d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98e4000f70 tx=0x7f98e4009040 comp rx=0 tx=0).stop 2024-09-10T11:47:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 -- 172.21.15.78:0/48279901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 msgr2=0x7f98e8151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 0x7f98e8151b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98d800d980 tx=0x7f98d800de40 comp rx=0 tx=0).stop 2024-09-10T11:47:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 -- 172.21.15.78:0/48279901 shutdown_connections 2024-09-10T11:47:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e815ada0 0x7f98e8152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f98d406f870 0x7f98d4071d30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e81543d0 0x7f98e8151b80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 --2- 172.21.15.78:0/48279901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98e80cdc00 0x7f98e81f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 -- 172.21.15.78:0/48279901 >> 172.21.15.78:0/48279901 conn(0x7f98e80b1570 msgr2=0x7f98e8153070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 -- 172.21.15.78:0/48279901 shutdown_connections 2024-09-10T11:47:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f98cbfff640 1 -- 172.21.15.78:0/48279901 wait complete. 2024-09-10T11:47:37.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-10T11:47:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f33680b3bd0 con 0x7f33680cf260 2024-09-10T11:47:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.490+0000 7f335dffb640 1 -- 172.21.15.78:0/3221312475 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f336405bb60 con 0x7f33680cf260 2024-09-10T11:47:37.494 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.498 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f335406f850 msgr2=0x7f3354071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f335406f850 0x7f3354071d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33580af000 tx=0x7f335801afd0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 msgr2=0x7f336814db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 0x7f336814db90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f336400b4a0 tx=0x7f336400b960 comp rx=0 tx=0).stop 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 shutdown_connections 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3368150ff0 0x7f336815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f335406f850 0x7f3354071d10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f336815a550 0x7f33680ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 --2- 172.21.15.78:0/3221312475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680cf260 0x7f336814db90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 >> 172.21.15.78:0/3221312475 conn(0x7f336806e9b0 msgr2=0x7f336806fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 shutdown_connections 2024-09-10T11:47:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.498+0000 7f336f694640 1 -- 172.21.15.78:0/3221312475 wait complete. 2024-09-10T11:47:37.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.506+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0b24005590 con 0x7f0b3c036700 2024-09-10T11:47:37.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.506+0000 7f0b2ffff640 1 -- 172.21.15.78:0/1100186043 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b440d7030 con 0x7f0b3c036700 2024-09-10T11:47:37.508 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.506+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b2806f7e0 msgr2=0x7f0b28071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.506+0000 7f0b2dffb640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b2806f7e0 0x7f0b28071ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b3801b580 tx=0x7f0b380a8040 comp rx=0 tx=0).stop 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.506+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b3c036700 msgr2=0x7f0b3c0d9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.506+0000 7f0b2dffb640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b3c036700 0x7f0b3c0d9630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b4406bff0 tx=0x7f0b44069bb0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 shutdown_connections 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b3c01c370 0x7f0b3c0d90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b2806f7e0 0x7f0b28071ca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b3c036700 0x7f0b3c0d9630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 --2- 172.21.15.78:0/1100186043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b3c00a480 0x7f0b3c045c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 >> 172.21.15.78:0/1100186043 conn(0x7f0b3c054570 msgr2=0x7f0b3c035250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 shutdown_connections 2024-09-10T11:47:37.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.510+0000 7f0b2dffb640 1 -- 172.21.15.78:0/1100186043 wait complete. 2024-09-10T11:47:37.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-10T11:47:37.516 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.518+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f315c0cefc0 con 0x7f315c15d9e0 2024-09-10T11:47:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31597fa640 1 -- 172.21.15.78:0/2220607198 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f314c05b9a0 con 0x7f315c15d9e0 2024-09-10T11:47:37.523 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-10T11:47:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1f8c01dc80 con 0x7f1f8c053ef0 2024-09-10T11:47:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f1f7bfff640 1 -- 172.21.15.78:0/2480075953 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f9410a030 con 0x7f1f8c053ef0 2024-09-10T11:47:37.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f313c06f710 msgr2=0x7f313c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f313c06f710 0x7f313c071bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f315c160250 tx=0x7f3144009260 comp rx=0 tx=0).stop 2024-09-10T11:47:37.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 msgr2=0x7f315c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 0x7f315c156bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c760 tx=0x7f314c00cc20 comp rx=0 tx=0).stop 2024-09-10T11:47:37.525 INFO:teuthology.orchestra.run.smithi078.stdout:64424509449 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 shutdown_connections 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c15ddc0 0x7f315c15b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f313c06f710 0x7f313c071bd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f315c15d9e0 0x7f315c156bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 --2- 172.21.15.78:0/2220607198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f315c0cc110 0x7f315c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 >> 172.21.15.78:0/2220607198 conn(0x7f315c0b1490 msgr2=0x7f315c0af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 shutdown_connections 2024-09-10T11:47:37.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.522+0000 7f31629f6640 1 -- 172.21.15.78:0/2220607198 wait complete. 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f8006f790 msgr2=0x7f1f80071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f8006f790 0x7f1f80071c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c055450 tx=0x7f1f8400d040 comp rx=0 tx=0).stop 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c053ef0 msgr2=0x7f1f8c04a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c053ef0 0x7f1f8c04a0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f9406b290 tx=0x7f1f94069aa0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 shutdown_connections 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c053ef0 0x7f1f8c04a0b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f8006f790 0x7f1f80071c50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f8c006ff0 0x7f1f8c04d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 --2- 172.21.15.78:0/2480075953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c005f50 0x7f1f8c0dba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 >> 172.21.15.78:0/2480075953 conn(0x7f1f8c01d780 msgr2=0x7f1f8c0505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 shutdown_connections 2024-09-10T11:47:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.526+0000 7f1f998a2640 1 -- 172.21.15.78:0/2480075953 wait complete. 2024-09-10T11:47:37.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-09-10T11:47:37.530 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-10T11:47:37.531 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-09-10T11:47:37.544 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-10T11:47:37.546 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.550+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f63880caba0 con 0x7f63880ca6f0 2024-09-10T11:47:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.550+0000 7f636ffff640 1 -- 172.21.15.78:0/3695714192 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f637805ccd0 con 0x7f63880ca6f0 2024-09-10T11:47:37.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.550+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6414143800 con 0x7f64141430b0 2024-09-10T11:47:37.554 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2024-09-10T11:47:37.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.550+0000 7f6410ff9640 1 -- 172.21.15.78:0/2965951290 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f640c05cc50 con 0x7f64141430b0 2024-09-10T11:47:37.554 INFO:teuthology.orchestra.run.smithi078.stdout:64424509449 2024-09-10T11:47:37.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f637406f710 msgr2=0x7f6374071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f637406f710 0x7f6374071bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63880cf460 tx=0x7f637c005c10 comp rx=0 tx=0).stop 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 msgr2=0x7f63880b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880b1600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f637800c480 tx=0x7f637800c940 comp rx=0 tx=0).stop 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 shutdown_connections 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815a500 0x7f638814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f637406f710 0x7f6374071bd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6388157a70 0x7f63881484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 --2- 172.21.15.78:0/3695714192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63880ca6f0 0x7f63880b1600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 >> 172.21.15.78:0/3695714192 conn(0x7f638806e9b0 msgr2=0x7f638814a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 shutdown_connections 2024-09-10T11:47:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f638db47640 1 -- 172.21.15.78:0/3695714192 wait complete. 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f640006f760 msgr2=0x7f6400071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f640006f760 0x7f6400071c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6404000f70 tx=0x7f64040079c0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 msgr2=0x7f6414156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 0x7f6414156bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f640c00eb20 tx=0x7f640c00c2d0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 shutdown_connections 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64141430b0 0x7f6414156bd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f640006f760 0x7f6400071c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6414154b20 0x7f6414156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 --2- 172.21.15.78:0/2965951290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6414073cb0 0x7f6414142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 >> 172.21.15.78:0/2965951290 conn(0x7f641406da60 msgr2=0x7f6414143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 shutdown_connections 2024-09-10T11:47:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.554+0000 7f641a432640 1 -- 172.21.15.78:0/2965951290 wait complete. 2024-09-10T11:47:37.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-10T11:47:37.572 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-10T11:47:37.573 DEBUG:teuthology.parallel:result is None 2024-09-10T11:47:37.573 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T11:47:37.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.718+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/3999899808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 msgr2=0x7f0b480ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.718+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/3999899808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 0x7f0b480ad8d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009900 tx=0x7f0b3c01c8e0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/3999899808 shutdown_connections 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/3999899808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 0x7f0b480ad8d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/3999899808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b4815b690 0x7f0b4815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/3999899808 >> 172.21.15.78:0/3999899808 conn(0x7f0b480d00a0 msgr2=0x7f0b480d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/3999899808 shutdown_connections 2024-09-10T11:47:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/3999899808 wait complete. 2024-09-10T11:47:37.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 Processor -- start 2024-09-10T11:47:37.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- start start 2024-09-10T11:47:37.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 0x7f0b481faa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b480ade10 0x7f0b48147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 0x7f0b480b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4816aed0 con 0x7f0b4815b690 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4816ad50 con 0x7f0b48074680 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4816b050 con 0x7f0b480ade10 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 0x7f0b480b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 0x7f0b480b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55290/0 (socket says 172.21.15.78:55290) 2024-09-10T11:47:37.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 -- 172.21.15.78:0/1418371941 learned_addr learned my addr 172.21.15.78:0/1418371941 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:37.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b47fff640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 0x7f0b481faa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b477fe640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b480ade10 0x7f0b48147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 -- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b480ade10 msgr2=0x7f0b48147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b480ade10 0x7f0b48147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 -- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 msgr2=0x7f0b481faa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 0x7f0b481faa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 -- 172.21.15.78:0/1418371941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b480b53d0 con 0x7f0b4815b690 2024-09-10T11:47:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4cf7f640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 0x7f0b480b30c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c7d0 tx=0x7f0b4000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40003b80 con 0x7f0b4815b690 2024-09-10T11:47:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b40003d20 con 0x7f0b4815b690 2024-09-10T11:47:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b48148530 con 0x7f0b4815b690 2024-09-10T11:47:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000aab0 con 0x7f0b4815b690 2024-09-10T11:47:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b48148af0 con 0x7f0b4815b690 2024-09-10T11:47:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.722+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b480ad8d0 con 0x7f0b4815b690 2024-09-10T11:47:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.726+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f0b4000ac50 con 0x7f0b4815b690 2024-09-10T11:47:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.726+0000 7f0b44ff9640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b3406f710 0x7f0b34071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.726+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b4008f6c0 con 0x7f0b4815b690 2024-09-10T11:47:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.726+0000 7f0b47fff640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b3406f710 0x7f0b34071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.726+0000 7f0b47fff640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b3406f710 0x7f0b34071bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b481551c0 tx=0x7f0b380091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.730+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0b4005c600 con 0x7f0b4815b690 2024-09-10T11:47:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.858+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b480d0d70 con 0x7f0b3406f710 2024-09-10T11:47:37.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.870+0000 7f0b44ff9640 1 -- 172.21.15.78:0/1418371941 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251821 (secure 0 0 0) 0x7f0b480d0d70 con 0x7f0b3406f710 2024-09-10T11:47:37.876 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:37.878 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b3406f710 msgr2=0x7f0b34071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b3406f710 0x7f0b34071bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b481551c0 tx=0x7f0b380091e0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 msgr2=0x7f0b480b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 0x7f0b480b30c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c7d0 tx=0x7f0b4000cc90 comp rx=0 tx=0).stop 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 shutdown_connections 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b3406f710 0x7f0b34071bd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b4815b690 0x7f0b480b30c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b480ade10 0x7f0b48147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 --2- 172.21.15.78:0/1418371941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b48074680 0x7f0b481faa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 >> 172.21.15.78:0/1418371941 conn(0x7f0b480d00a0 msgr2=0x7f0b4814f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 shutdown_connections 2024-09-10T11:47:37.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:37.874+0000 7f0b4e9e2640 1 -- 172.21.15.78:0/1418371941 wait complete. 2024-09-10T11:47:37.893 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-10T11:47:37.241633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223480,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751240,"statfs":{"total":773094113280,"available":772865269760,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.515991"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027494+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:47:29.027494+0000","last_peered":"2024-09-10T11:47:29.027494+0000","last_clean":"2024-09-10T11:47:29.027494+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:47:29.027494+0000","last_undegraded":"2024-09-10T11:47:29.027494+0000","last_fullsized":"2024-09-10T11:47:29.027494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736580+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:47:28.736580+0000","last_peered":"2024-09-10T11:47:28.736580+0000","last_clean":"2024-09-10T11:47:28.736580+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:47:28.736580+0000","last_undegraded":"2024-09-10T11:47:28.736580+0000","last_fullsized":"2024-09-10T11:47:28.736580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735707+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:47:28.735707+0000","last_peered":"2024-09-10T11:47:28.735707+0000","last_clean":"2024-09-10T11:47:28.735707+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:47:28.735707+0000","last_undegraded":"2024-09-10T11:47:28.735707+0000","last_fullsized":"2024-09-10T11:47:28.735707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026400+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:47:29.026400+0000","last_peered":"2024-09-10T11:47:29.026400+0000","last_clean":"2024-09-10T11:47:29.026400+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:47:29.026400+0000","last_undegraded":"2024-09-10T11:47:29.026400+0000","last_fullsized":"2024-09-10T11:47:29.026400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027309+0000","last_change":"2024-09-10T11:47:27.775231+0000","last_active":"2024-09-10T11:47:29.027309+0000","last_peered":"2024-09-10T11:47:29.027309+0000","last_clean":"2024-09-10T11:47:29.027309+0000","last_became_active":"2024-09-10T11:47:27.774770+0000","last_became_peered":"2024-09-10T11:47:27.774770+0000","last_unstale":"2024-09-10T11:47:29.027309+0000","last_undegraded":"2024-09-10T11:47:29.027309+0000","last_fullsized":"2024-09-10T11:47:29.027309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:41.280383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026629+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:47:29.026629+0000","last_peered":"2024-09-10T11:47:29.026629+0000","last_clean":"2024-09-10T11:47:29.026629+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:47:29.026629+0000","last_undegraded":"2024-09-10T11:47:29.026629+0000","last_fullsized":"2024-09-10T11:47:29.026629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025616+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:47:29.025616+0000","last_peered":"2024-09-10T11:47:29.025616+0000","last_clean":"2024-09-10T11:47:29.025616+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:47:29.025616+0000","last_undegraded":"2024-09-10T11:47:29.025616+0000","last_fullsized":"2024-09-10T11:47:29.025616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.734995+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:47:28.734995+0000","last_peered":"2024-09-10T11:47:28.734995+0000","last_clean":"2024-09-10T11:47:28.734995+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:47:28.734995+0000","last_undegraded":"2024-09-10T11:47:28.734995+0000","last_fullsized":"2024-09-10T11:47:28.734995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.980094+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:47:28.980094+0000","last_peered":"2024-09-10T11:47:28.980094+0000","last_clean":"2024-09-10T11:47:28.980094+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:47:28.980094+0000","last_undegraded":"2024-09-10T11:47:28.980094+0000","last_fullsized":"2024-09-10T11:47:28.980094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027321+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:47:29.027321+0000","last_peered":"2024-09-10T11:47:29.027321+0000","last_clean":"2024-09-10T11:47:29.027321+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:47:29.027321+0000","last_undegraded":"2024-09-10T11:47:29.027321+0000","last_fullsized":"2024-09-10T11:47:29.027321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025838+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:47:29.025838+0000","last_peered":"2024-09-10T11:47:29.025838+0000","last_clean":"2024-09-10T11:47:29.025838+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:47:29.025838+0000","last_undegraded":"2024-09-10T11:47:29.025838+0000","last_fullsized":"2024-09-10T11:47:29.025838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025544+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:47:29.025544+0000","last_peered":"2024-09-10T11:47:29.025544+0000","last_clean":"2024-09-10T11:47:29.025544+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:47:29.025544+0000","last_undegraded":"2024-09-10T11:47:29.025544+0000","last_fullsized":"2024-09-10T11:47:29.025544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028088+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:47:29.028088+0000","last_peered":"2024-09-10T11:47:29.028088+0000","last_clean":"2024-09-10T11:47:29.028088+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:47:29.028088+0000","last_undegraded":"2024-09-10T11:47:29.028088+0000","last_fullsized":"2024-09-10T11:47:29.028088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027598+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:47:29.027598+0000","last_peered":"2024-09-10T11:47:29.027598+0000","last_clean":"2024-09-10T11:47:29.027598+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:47:29.027598+0000","last_undegraded":"2024-09-10T11:47:29.027598+0000","last_fullsized":"2024-09-10T11:47:29.027598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.734976+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:47:28.734976+0000","last_peered":"2024-09-10T11:47:28.734976+0000","last_clean":"2024-09-10T11:47:28.734976+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:47:28.734976+0000","last_undegraded":"2024-09-10T11:47:28.734976+0000","last_fullsized":"2024-09-10T11:47:28.734976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728711+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:47:28.728711+0000","last_peered":"2024-09-10T11:47:28.728711+0000","last_clean":"2024-09-10T11:47:28.728711+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:47:28.728711+0000","last_undegraded":"2024-09-10T11:47:28.728711+0000","last_fullsized":"2024-09-10T11:47:28.728711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729812+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:47:28.729812+0000","last_peered":"2024-09-10T11:47:28.729812+0000","last_clean":"2024-09-10T11:47:28.729812+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:47:28.729812+0000","last_undegraded":"2024-09-10T11:47:28.729812+0000","last_fullsized":"2024-09-10T11:47:28.729812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960859+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:47:28.960859+0000","last_peered":"2024-09-10T11:47:28.960859+0000","last_clean":"2024-09-10T11:47:28.960859+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:47:28.960859+0000","last_undegraded":"2024-09-10T11:47:28.960859+0000","last_fullsized":"2024-09-10T11:47:28.960859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729574+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:47:28.729574+0000","last_peered":"2024-09-10T11:47:28.729574+0000","last_clean":"2024-09-10T11:47:28.729574+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:47:28.729574+0000","last_undegraded":"2024-09-10T11:47:28.729574+0000","last_fullsized":"2024-09-10T11:47:28.729574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025283+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:47:29.025283+0000","last_peered":"2024-09-10T11:47:29.025283+0000","last_clean":"2024-09-10T11:47:29.025283+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:47:29.025283+0000","last_undegraded":"2024-09-10T11:47:29.025283+0000","last_fullsized":"2024-09-10T11:47:29.025283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737064+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:47:28.737064+0000","last_peered":"2024-09-10T11:47:28.737064+0000","last_clean":"2024-09-10T11:47:28.737064+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:47:28.737064+0000","last_undegraded":"2024-09-10T11:47:28.737064+0000","last_fullsized":"2024-09-10T11:47:28.737064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979793+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:47:28.979793+0000","last_peered":"2024-09-10T11:47:28.979793+0000","last_clean":"2024-09-10T11:47:28.979793+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:47:28.979793+0000","last_undegraded":"2024-09-10T11:47:28.979793+0000","last_fullsized":"2024-09-10T11:47:28.979793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735276+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:47:28.735276+0000","last_peered":"2024-09-10T11:47:28.735276+0000","last_clean":"2024-09-10T11:47:28.735276+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:47:28.735276+0000","last_undegraded":"2024-09-10T11:47:28.735276+0000","last_fullsized":"2024-09-10T11:47:28.735276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728453+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:47:28.728453+0000","last_peered":"2024-09-10T11:47:28.728453+0000","last_clean":"2024-09-10T11:47:28.728453+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:47:28.728453+0000","last_undegraded":"2024-09-10T11:47:28.728453+0000","last_fullsized":"2024-09-10T11:47:28.728453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735753+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:47:28.735753+0000","last_peered":"2024-09-10T11:47:28.735753+0000","last_clean":"2024-09-10T11:47:28.735753+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:47:28.735753+0000","last_undegraded":"2024-09-10T11:47:28.735753+0000","last_fullsized":"2024-09-10T11:47:28.735753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027230+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:47:29.027230+0000","last_peered":"2024-09-10T11:47:29.027230+0000","last_clean":"2024-09-10T11:47:29.027230+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:47:29.027230+0000","last_undegraded":"2024-09-10T11:47:29.027230+0000","last_fullsized":"2024-09-10T11:47:29.027230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028342+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:47:29.028342+0000","last_peered":"2024-09-10T11:47:29.028342+0000","last_clean":"2024-09-10T11:47:29.028342+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:47:29.028342+0000","last_undegraded":"2024-09-10T11:47:29.028342+0000","last_fullsized":"2024-09-10T11:47:29.028342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027954+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:47:29.027954+0000","last_peered":"2024-09-10T11:47:29.027954+0000","last_clean":"2024-09-10T11:47:29.027954+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:47:29.027954+0000","last_undegraded":"2024-09-10T11:47:29.027954+0000","last_fullsized":"2024-09-10T11:47:29.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735405+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:47:28.735405+0000","last_peered":"2024-09-10T11:47:28.735405+0000","last_clean":"2024-09-10T11:47:28.735405+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:47:28.735405+0000","last_undegraded":"2024-09-10T11:47:28.735405+0000","last_fullsized":"2024-09-10T11:47:28.735405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729094+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:47:28.729094+0000","last_peered":"2024-09-10T11:47:28.729094+0000","last_clean":"2024-09-10T11:47:28.729094+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:47:28.729094+0000","last_undegraded":"2024-09-10T11:47:28.729094+0000","last_fullsized":"2024-09-10T11:47:28.729094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960185+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:47:28.960185+0000","last_peered":"2024-09-10T11:47:28.960185+0000","last_clean":"2024-09-10T11:47:28.960185+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:47:28.960185+0000","last_undegraded":"2024-09-10T11:47:28.960185+0000","last_fullsized":"2024-09-10T11:47:28.960185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026051+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:47:29.026051+0000","last_peered":"2024-09-10T11:47:29.026051+0000","last_clean":"2024-09-10T11:47:29.026051+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:47:29.026051+0000","last_undegraded":"2024-09-10T11:47:29.026051+0000","last_fullsized":"2024-09-10T11:47:29.026051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979892+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:47:28.979892+0000","last_peered":"2024-09-10T11:47:28.979892+0000","last_clean":"2024-09-10T11:47:28.979892+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:47:28.979892+0000","last_undegraded":"2024-09-10T11:47:28.979892+0000","last_fullsized":"2024-09-10T11:47:28.979892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735001+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:47:28.735001+0000","last_peered":"2024-09-10T11:47:28.735001+0000","last_clean":"2024-09-10T11:47:28.735001+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:47:28.735001+0000","last_undegraded":"2024-09-10T11:47:28.735001+0000","last_fullsized":"2024-09-10T11:47:28.735001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737672+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:47:28.737672+0000","last_peered":"2024-09-10T11:47:28.737672+0000","last_clean":"2024-09-10T11:47:28.737672+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:47:28.737672+0000","last_undegraded":"2024-09-10T11:47:28.737672+0000","last_fullsized":"2024-09-10T11:47:28.737672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728990+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:47:28.728990+0000","last_peered":"2024-09-10T11:47:28.728990+0000","last_clean":"2024-09-10T11:47:28.728990+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:47:28.728990+0000","last_undegraded":"2024-09-10T11:47:28.728990+0000","last_fullsized":"2024-09-10T11:47:28.728990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027197+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:47:29.027197+0000","last_peered":"2024-09-10T11:47:29.027197+0000","last_clean":"2024-09-10T11:47:29.027197+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:47:29.027197+0000","last_undegraded":"2024-09-10T11:47:29.027197+0000","last_fullsized":"2024-09-10T11:47:29.027197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735590+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:47:28.735590+0000","last_peered":"2024-09-10T11:47:28.735590+0000","last_clean":"2024-09-10T11:47:28.735590+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:47:28.735590+0000","last_undegraded":"2024-09-10T11:47:28.735590+0000","last_fullsized":"2024-09-10T11:47:28.735590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728602+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:47:28.728602+0000","last_peered":"2024-09-10T11:47:28.728602+0000","last_clean":"2024-09-10T11:47:28.728602+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:47:28.728602+0000","last_undegraded":"2024-09-10T11:47:28.728602+0000","last_fullsized":"2024-09-10T11:47:28.728602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737137+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:47:28.737137+0000","last_peered":"2024-09-10T11:47:28.737137+0000","last_clean":"2024-09-10T11:47:28.737137+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:47:28.737137+0000","last_undegraded":"2024-09-10T11:47:28.737137+0000","last_fullsized":"2024-09-10T11:47:28.737137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979920+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:47:28.979920+0000","last_peered":"2024-09-10T11:47:28.979920+0000","last_clean":"2024-09-10T11:47:28.979920+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:47:28.979920+0000","last_undegraded":"2024-09-10T11:47:28.979920+0000","last_fullsized":"2024-09-10T11:47:28.979920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027801+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:47:29.027801+0000","last_peered":"2024-09-10T11:47:29.027801+0000","last_clean":"2024-09-10T11:47:29.027801+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:47:29.027801+0000","last_undegraded":"2024-09-10T11:47:29.027801+0000","last_fullsized":"2024-09-10T11:47:29.027801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025578+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:47:29.025578+0000","last_peered":"2024-09-10T11:47:29.025578+0000","last_clean":"2024-09-10T11:47:29.025578+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:47:29.025578+0000","last_undegraded":"2024-09-10T11:47:29.025578+0000","last_fullsized":"2024-09-10T11:47:29.025578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736301+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:47:28.736301+0000","last_peered":"2024-09-10T11:47:28.736301+0000","last_clean":"2024-09-10T11:47:28.736301+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:47:28.736301+0000","last_undegraded":"2024-09-10T11:47:28.736301+0000","last_fullsized":"2024-09-10T11:47:28.736301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960223+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:47:28.960223+0000","last_peered":"2024-09-10T11:47:28.960223+0000","last_clean":"2024-09-10T11:47:28.960223+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:47:28.960223+0000","last_undegraded":"2024-09-10T11:47:28.960223+0000","last_fullsized":"2024-09-10T11:47:28.960223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729007+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:47:28.729007+0000","last_peered":"2024-09-10T11:47:28.729007+0000","last_clean":"2024-09-10T11:47:28.729007+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:47:28.729007+0000","last_undegraded":"2024-09-10T11:47:28.729007+0000","last_fullsized":"2024-09-10T11:47:28.729007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026465+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:47:29.026465+0000","last_peered":"2024-09-10T11:47:29.026465+0000","last_clean":"2024-09-10T11:47:29.026465+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:47:29.026465+0000","last_undegraded":"2024-09-10T11:47:29.026465+0000","last_fullsized":"2024-09-10T11:47:29.026465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026349+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:47:29.026349+0000","last_peered":"2024-09-10T11:47:29.026349+0000","last_clean":"2024-09-10T11:47:29.026349+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:47:29.026349+0000","last_undegraded":"2024-09-10T11:47:29.026349+0000","last_fullsized":"2024-09-10T11:47:29.026349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960162+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:47:28.960162+0000","last_peered":"2024-09-10T11:47:28.960162+0000","last_clean":"2024-09-10T11:47:28.960162+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:47:28.960162+0000","last_undegraded":"2024-09-10T11:47:28.960162+0000","last_fullsized":"2024-09-10T11:47:28.960162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027867+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:47:29.027867+0000","last_peered":"2024-09-10T11:47:29.027867+0000","last_clean":"2024-09-10T11:47:29.027867+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:47:29.027867+0000","last_undegraded":"2024-09-10T11:47:29.027867+0000","last_fullsized":"2024-09-10T11:47:29.027867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729129+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:47:28.729129+0000","last_peered":"2024-09-10T11:47:28.729129+0000","last_clean":"2024-09-10T11:47:28.729129+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:47:28.729129+0000","last_undegraded":"2024-09-10T11:47:28.729129+0000","last_fullsized":"2024-09-10T11:47:28.729129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729289+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:47:28.729289+0000","last_peered":"2024-09-10T11:47:28.729289+0000","last_clean":"2024-09-10T11:47:28.729289+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:47:28.729289+0000","last_undegraded":"2024-09-10T11:47:28.729289+0000","last_fullsized":"2024-09-10T11:47:28.729289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025764+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:47:29.025764+0000","last_peered":"2024-09-10T11:47:29.025764+0000","last_clean":"2024-09-10T11:47:29.025764+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:47:29.025764+0000","last_undegraded":"2024-09-10T11:47:29.025764+0000","last_fullsized":"2024-09-10T11:47:29.025764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979529+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:47:28.979529+0000","last_peered":"2024-09-10T11:47:28.979529+0000","last_clean":"2024-09-10T11:47:28.979529+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:47:28.979529+0000","last_undegraded":"2024-09-10T11:47:28.979529+0000","last_fullsized":"2024-09-10T11:47:28.979529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736199+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:47:28.736199+0000","last_peered":"2024-09-10T11:47:28.736199+0000","last_clean":"2024-09-10T11:47:28.736199+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:47:28.736199+0000","last_undegraded":"2024-09-10T11:47:28.736199+0000","last_fullsized":"2024-09-10T11:47:28.736199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728908+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:47:28.728908+0000","last_peered":"2024-09-10T11:47:28.728908+0000","last_clean":"2024-09-10T11:47:28.728908+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:47:28.728908+0000","last_undegraded":"2024-09-10T11:47:28.728908+0000","last_fullsized":"2024-09-10T11:47:28.728908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027636+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:47:29.027636+0000","last_peered":"2024-09-10T11:47:29.027636+0000","last_clean":"2024-09-10T11:47:29.027636+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:47:29.027636+0000","last_undegraded":"2024-09-10T11:47:29.027636+0000","last_fullsized":"2024-09-10T11:47:29.027636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027946+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:47:29.027946+0000","last_peered":"2024-09-10T11:47:29.027946+0000","last_clean":"2024-09-10T11:47:29.027946+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:47:29.027946+0000","last_undegraded":"2024-09-10T11:47:29.027946+0000","last_fullsized":"2024-09-10T11:47:29.027946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737330+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:47:28.737330+0000","last_peered":"2024-09-10T11:47:28.737330+0000","last_clean":"2024-09-10T11:47:28.737330+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:47:28.737330+0000","last_undegraded":"2024-09-10T11:47:28.737330+0000","last_fullsized":"2024-09-10T11:47:28.737330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027844+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:47:29.027844+0000","last_peered":"2024-09-10T11:47:29.027844+0000","last_clean":"2024-09-10T11:47:29.027844+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:47:29.027844+0000","last_undegraded":"2024-09-10T11:47:29.027844+0000","last_fullsized":"2024-09-10T11:47:29.027844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735825+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:47:28.735825+0000","last_peered":"2024-09-10T11:47:28.735825+0000","last_clean":"2024-09-10T11:47:28.735825+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:47:28.735825+0000","last_undegraded":"2024-09-10T11:47:28.735825+0000","last_fullsized":"2024-09-10T11:47:28.735825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026767+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:47:29.026767+0000","last_peered":"2024-09-10T11:47:29.026767+0000","last_clean":"2024-09-10T11:47:29.026767+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:47:29.026767+0000","last_undegraded":"2024-09-10T11:47:29.026767+0000","last_fullsized":"2024-09-10T11:47:29.026767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028201+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:47:29.028201+0000","last_peered":"2024-09-10T11:47:29.028201+0000","last_clean":"2024-09-10T11:47:29.028201+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:47:29.028201+0000","last_undegraded":"2024-09-10T11:47:29.028201+0000","last_fullsized":"2024-09-10T11:47:29.028201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729404+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:47:28.729404+0000","last_peered":"2024-09-10T11:47:28.729404+0000","last_clean":"2024-09-10T11:47:28.729404+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:47:28.729404+0000","last_undegraded":"2024-09-10T11:47:28.729404+0000","last_fullsized":"2024-09-10T11:47:28.729404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979210+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:28.979210+0000","last_peered":"2024-09-10T11:47:28.979210+0000","last_clean":"2024-09-10T11:47:28.979210+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:28.979210+0000","last_undegraded":"2024-09-10T11:47:28.979210+0000","last_fullsized":"2024-09-10T11:47:28.979210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729364+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:47:28.729364+0000","last_peered":"2024-09-10T11:47:28.729364+0000","last_clean":"2024-09-10T11:47:28.729364+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:47:28.729364+0000","last_undegraded":"2024-09-10T11:47:28.729364+0000","last_fullsized":"2024-09-10T11:47:28.729364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737923+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:47:28.737923+0000","last_peered":"2024-09-10T11:47:28.737923+0000","last_clean":"2024-09-10T11:47:28.737923+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:47:28.737923+0000","last_undegraded":"2024-09-10T11:47:28.737923+0000","last_fullsized":"2024-09-10T11:47:28.737923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728742+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:47:28.728742+0000","last_peered":"2024-09-10T11:47:28.728742+0000","last_clean":"2024-09-10T11:47:28.728742+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:47:28.728742+0000","last_undegraded":"2024-09-10T11:47:28.728742+0000","last_fullsized":"2024-09-10T11:47:28.728742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027527+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:47:29.027527+0000","last_peered":"2024-09-10T11:47:29.027527+0000","last_clean":"2024-09-10T11:47:29.027527+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:47:29.027527+0000","last_undegraded":"2024-09-10T11:47:29.027527+0000","last_fullsized":"2024-09-10T11:47:29.027527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.959820+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:47:28.959820+0000","last_peered":"2024-09-10T11:47:28.959820+0000","last_clean":"2024-09-10T11:47:28.959820+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:47:28.959820+0000","last_undegraded":"2024-09-10T11:47:28.959820+0000","last_fullsized":"2024-09-10T11:47:28.959820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735428+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:47:28.735428+0000","last_peered":"2024-09-10T11:47:28.735428+0000","last_clean":"2024-09-10T11:47:28.735428+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:47:28.735428+0000","last_undegraded":"2024-09-10T11:47:28.735428+0000","last_fullsized":"2024-09-10T11:47:28.735428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729232+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:47:28.729232+0000","last_peered":"2024-09-10T11:47:28.729232+0000","last_clean":"2024-09-10T11:47:28.729232+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:47:28.729232+0000","last_undegraded":"2024-09-10T11:47:28.729232+0000","last_fullsized":"2024-09-10T11:47:28.729232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026538+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:47:29.026538+0000","last_peered":"2024-09-10T11:47:29.026538+0000","last_clean":"2024-09-10T11:47:29.026538+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:47:29.026538+0000","last_undegraded":"2024-09-10T11:47:29.026538+0000","last_fullsized":"2024-09-10T11:47:29.026538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735750+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:47:28.735750+0000","last_peered":"2024-09-10T11:47:28.735750+0000","last_clean":"2024-09-10T11:47:28.735750+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:47:28.735750+0000","last_undegraded":"2024-09-10T11:47:28.735750+0000","last_fullsized":"2024-09-10T11:47:28.735750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027782+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:47:29.027782+0000","last_peered":"2024-09-10T11:47:29.027782+0000","last_clean":"2024-09-10T11:47:29.027782+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:47:29.027782+0000","last_undegraded":"2024-09-10T11:47:29.027782+0000","last_fullsized":"2024-09-10T11:47:29.027782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729583+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:47:28.729583+0000","last_peered":"2024-09-10T11:47:28.729583+0000","last_clean":"2024-09-10T11:47:28.729583+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:47:28.729583+0000","last_undegraded":"2024-09-10T11:47:28.729583+0000","last_fullsized":"2024-09-10T11:47:28.729583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028075+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:47:29.028075+0000","last_peered":"2024-09-10T11:47:29.028075+0000","last_clean":"2024-09-10T11:47:29.028075+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:47:29.028075+0000","last_undegraded":"2024-09-10T11:47:29.028075+0000","last_fullsized":"2024-09-10T11:47:29.028075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737699+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:47:28.737699+0000","last_peered":"2024-09-10T11:47:28.737699+0000","last_clean":"2024-09-10T11:47:28.737699+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:47:28.737699+0000","last_undegraded":"2024-09-10T11:47:28.737699+0000","last_fullsized":"2024-09-10T11:47:28.737699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737759+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:47:28.737759+0000","last_peered":"2024-09-10T11:47:28.737759+0000","last_clean":"2024-09-10T11:47:28.737759+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:47:28.737759+0000","last_undegraded":"2024-09-10T11:47:28.737759+0000","last_fullsized":"2024-09-10T11:47:28.737759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729656+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:47:28.729656+0000","last_peered":"2024-09-10T11:47:28.729656+0000","last_clean":"2024-09-10T11:47:28.729656+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:47:28.729656+0000","last_undegraded":"2024-09-10T11:47:28.729656+0000","last_fullsized":"2024-09-10T11:47:28.729656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737163+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:47:28.737163+0000","last_peered":"2024-09-10T11:47:28.737163+0000","last_clean":"2024-09-10T11:47:28.737163+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:47:28.737163+0000","last_undegraded":"2024-09-10T11:47:28.737163+0000","last_fullsized":"2024-09-10T11:47:28.737163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.024602+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:47:29.024602+0000","last_peered":"2024-09-10T11:47:29.024602+0000","last_clean":"2024-09-10T11:47:29.024602+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:47:29.024602+0000","last_undegraded":"2024-09-10T11:47:29.024602+0000","last_fullsized":"2024-09-10T11:47:29.024602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728601+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:47:28.728601+0000","last_peered":"2024-09-10T11:47:28.728601+0000","last_clean":"2024-09-10T11:47:28.728601+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:47:28.728601+0000","last_undegraded":"2024-09-10T11:47:28.728601+0000","last_fullsized":"2024-09-10T11:47:28.728601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737189+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:47:28.737189+0000","last_peered":"2024-09-10T11:47:28.737189+0000","last_clean":"2024-09-10T11:47:28.737189+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:47:28.737189+0000","last_undegraded":"2024-09-10T11:47:28.737189+0000","last_fullsized":"2024-09-10T11:47:28.737189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736572+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:47:28.736572+0000","last_peered":"2024-09-10T11:47:28.736572+0000","last_clean":"2024-09-10T11:47:28.736572+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:47:28.736572+0000","last_undegraded":"2024-09-10T11:47:28.736572+0000","last_fullsized":"2024-09-10T11:47:28.736572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027901+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:47:29.027901+0000","last_peered":"2024-09-10T11:47:29.027901+0000","last_clean":"2024-09-10T11:47:29.027901+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:47:29.027901+0000","last_undegraded":"2024-09-10T11:47:29.027901+0000","last_fullsized":"2024-09-10T11:47:29.027901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960407+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:47:28.960407+0000","last_peered":"2024-09-10T11:47:28.960407+0000","last_clean":"2024-09-10T11:47:28.960407+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:47:28.960407+0000","last_undegraded":"2024-09-10T11:47:28.960407+0000","last_fullsized":"2024-09-10T11:47:28.960407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729246+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:47:28.729246+0000","last_peered":"2024-09-10T11:47:28.729246+0000","last_clean":"2024-09-10T11:47:28.729246+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:47:28.729246+0000","last_undegraded":"2024-09-10T11:47:28.729246+0000","last_fullsized":"2024-09-10T11:47:28.729246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728919+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:47:28.728919+0000","last_peered":"2024-09-10T11:47:28.728919+0000","last_clean":"2024-09-10T11:47:28.728919+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:47:28.728919+0000","last_undegraded":"2024-09-10T11:47:28.728919+0000","last_fullsized":"2024-09-10T11:47:28.728919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729488+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:47:28.729488+0000","last_peered":"2024-09-10T11:47:28.729488+0000","last_clean":"2024-09-10T11:47:28.729488+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:47:28.729488+0000","last_undegraded":"2024-09-10T11:47:28.729488+0000","last_fullsized":"2024-09-10T11:47:28.729488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025710+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:47:29.025710+0000","last_peered":"2024-09-10T11:47:29.025710+0000","last_clean":"2024-09-10T11:47:29.025710+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:47:29.025710+0000","last_undegraded":"2024-09-10T11:47:29.025710+0000","last_fullsized":"2024-09-10T11:47:29.025710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979544+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:47:28.979544+0000","last_peered":"2024-09-10T11:47:28.979544+0000","last_clean":"2024-09-10T11:47:28.979544+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:47:28.979544+0000","last_undegraded":"2024-09-10T11:47:28.979544+0000","last_fullsized":"2024-09-10T11:47:28.979544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026498+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:47:29.026498+0000","last_peered":"2024-09-10T11:47:29.026498+0000","last_clean":"2024-09-10T11:47:29.026498+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:47:29.026498+0000","last_undegraded":"2024-09-10T11:47:29.026498+0000","last_fullsized":"2024-09-10T11:47:29.026498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736130+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:47:28.736130+0000","last_peered":"2024-09-10T11:47:28.736130+0000","last_clean":"2024-09-10T11:47:28.736130+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:47:28.736130+0000","last_undegraded":"2024-09-10T11:47:28.736130+0000","last_fullsized":"2024-09-10T11:47:28.736130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736743+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:47:28.736743+0000","last_peered":"2024-09-10T11:47:28.736743+0000","last_clean":"2024-09-10T11:47:28.736743+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:47:28.736743+0000","last_undegraded":"2024-09-10T11:47:28.736743+0000","last_fullsized":"2024-09-10T11:47:28.736743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737047+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:47:28.737047+0000","last_peered":"2024-09-10T11:47:28.737047+0000","last_clean":"2024-09-10T11:47:28.737047+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:47:28.737047+0000","last_undegraded":"2024-09-10T11:47:28.737047+0000","last_fullsized":"2024-09-10T11:47:28.737047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737522+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:47:28.737522+0000","last_peered":"2024-09-10T11:47:28.737522+0000","last_clean":"2024-09-10T11:47:28.737522+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:47:28.737522+0000","last_undegraded":"2024-09-10T11:47:28.737522+0000","last_fullsized":"2024-09-10T11:47:28.737522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:37.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:47:38.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- 172.21.15.78:0/1839734019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec161250 msgr2=0x7f1fec0d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/1839734019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec161250 0x7f1fec0d4770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009840 tx=0x7f1fdc01c7f0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- 172.21.15.78:0/1839734019 shutdown_connections 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/1839734019 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161630 0x7f1fec0d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/1839734019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec161250 0x7f1fec0d4770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- 172.21.15.78:0/1839734019 >> 172.21.15.78:0/1839734019 conn(0x7f1fec0d3c80 msgr2=0x7f1fec0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- 172.21.15.78:0/1839734019 shutdown_connections 2024-09-10T11:47:38.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- 172.21.15.78:0/1839734019 wait complete. 2024-09-10T11:47:38.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 Processor -- start 2024-09-10T11:47:38.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- start start 2024-09-10T11:47:38.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0b4a10 0x7f1fec15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161250 0x7f1fec0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 0x7f1fec15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec16b140 con 0x7f1fec161630 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec16afc0 con 0x7f1fec0b4a10 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.050+0000 7f1ff2f99640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec16b2c0 con 0x7f1fec161250 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 0x7f1fec15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 0x7f1fec15d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55304/0 (socket says 172.21.15.78:55304) 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 -- 172.21.15.78:0/4011499117 learned_addr learned my addr 172.21.15.78:0/4011499117 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1febfff640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161250 0x7f1fec0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff0d35640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0b4a10 0x7f1fec15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 -- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161250 msgr2=0x7f1fec0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161250 0x7f1fec0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 -- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0b4a10 msgr2=0x7f1fec15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0b4a10 0x7f1fec15c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 -- 172.21.15.78:0/4011499117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec15de80 con 0x7f1fec161630 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1febfff640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161250 0x7f1fec0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff1536640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 0x7f1fec15d230 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400cbc0 tx=0x7f1fe400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4016020 con 0x7f1fec161630 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fe400ab40 con 0x7f1fec161630 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec15b600 con 0x7f1fec161630 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4012420 con 0x7f1fec161630 2024-09-10T11:47:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec15b8a0 con 0x7f1fec161630 2024-09-10T11:47:38.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec0d4770 con 0x7f1fec161630 2024-09-10T11:47:38.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1fe4019020 con 0x7f1fec161630 2024-09-10T11:47:38.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1fe97fa640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fd806f710 0x7f1fd8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe408faa0 con 0x7f1fec161630 2024-09-10T11:47:38.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff0d35640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fd806f710 0x7f1fd8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.054+0000 7f1ff0d35640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fd806f710 0x7f1fd8071bd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0af000 tx=0x7f1fdc01b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.058+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1fe4020020 con 0x7f1fec161630 2024-09-10T11:47:38.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.190+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fec0d4470 con 0x7f1fd806f710 2024-09-10T11:47:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.202+0000 7f1fe97fa640 1 -- 172.21.15.78:0/4011499117 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251821 (secure 0 0 0) 0x7f1fec0d4470 con 0x7f1fd806f710 2024-09-10T11:47:38.207 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:47:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fd806f710 msgr2=0x7f1fd8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fd806f710 0x7f1fd8071bd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0af000 tx=0x7f1fdc01b030 comp rx=0 tx=0).stop 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 msgr2=0x7f1fec15d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 0x7f1fec15d230 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400cbc0 tx=0x7f1fe400ccb0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 shutdown_connections 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fd806f710 0x7f1fd8071bd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fec161630 0x7f1fec15d230 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fec161250 0x7f1fec0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 --2- 172.21.15.78:0/4011499117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0b4a10 0x7f1fec15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 >> 172.21.15.78:0/4011499117 conn(0x7f1fec0d3c80 msgr2=0x7f1fec15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 shutdown_connections 2024-09-10T11:47:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.206+0000 7f1ff2f99640 1 -- 172.21.15.78:0/4011499117 wait complete. 2024-09-10T11:47:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-10T11:47:37.241633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223480,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751240,"statfs":{"total":773094113280,"available":772865269760,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.515991"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027494+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:47:29.027494+0000","last_peered":"2024-09-10T11:47:29.027494+0000","last_clean":"2024-09-10T11:47:29.027494+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:47:29.027494+0000","last_undegraded":"2024-09-10T11:47:29.027494+0000","last_fullsized":"2024-09-10T11:47:29.027494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736580+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:47:28.736580+0000","last_peered":"2024-09-10T11:47:28.736580+0000","last_clean":"2024-09-10T11:47:28.736580+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:47:28.736580+0000","last_undegraded":"2024-09-10T11:47:28.736580+0000","last_fullsized":"2024-09-10T11:47:28.736580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735707+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:47:28.735707+0000","last_peered":"2024-09-10T11:47:28.735707+0000","last_clean":"2024-09-10T11:47:28.735707+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:47:28.735707+0000","last_undegraded":"2024-09-10T11:47:28.735707+0000","last_fullsized":"2024-09-10T11:47:28.735707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026400+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:47:29.026400+0000","last_peered":"2024-09-10T11:47:29.026400+0000","last_clean":"2024-09-10T11:47:29.026400+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:47:29.026400+0000","last_undegraded":"2024-09-10T11:47:29.026400+0000","last_fullsized":"2024-09-10T11:47:29.026400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027309+0000","last_change":"2024-09-10T11:47:27.775231+0000","last_active":"2024-09-10T11:47:29.027309+0000","last_peered":"2024-09-10T11:47:29.027309+0000","last_clean":"2024-09-10T11:47:29.027309+0000","last_became_active":"2024-09-10T11:47:27.774770+0000","last_became_peered":"2024-09-10T11:47:27.774770+0000","last_unstale":"2024-09-10T11:47:29.027309+0000","last_undegraded":"2024-09-10T11:47:29.027309+0000","last_fullsized":"2024-09-10T11:47:29.027309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:41.280383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026629+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:47:29.026629+0000","last_peered":"2024-09-10T11:47:29.026629+0000","last_clean":"2024-09-10T11:47:29.026629+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:47:29.026629+0000","last_undegraded":"2024-09-10T11:47:29.026629+0000","last_fullsized":"2024-09-10T11:47:29.026629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025616+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:47:29.025616+0000","last_peered":"2024-09-10T11:47:29.025616+0000","last_clean":"2024-09-10T11:47:29.025616+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:47:29.025616+0000","last_undegraded":"2024-09-10T11:47:29.025616+0000","last_fullsized":"2024-09-10T11:47:29.025616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.734995+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:47:28.734995+0000","last_peered":"2024-09-10T11:47:28.734995+0000","last_clean":"2024-09-10T11:47:28.734995+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:47:28.734995+0000","last_undegraded":"2024-09-10T11:47:28.734995+0000","last_fullsized":"2024-09-10T11:47:28.734995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.980094+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:47:28.980094+0000","last_peered":"2024-09-10T11:47:28.980094+0000","last_clean":"2024-09-10T11:47:28.980094+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:47:28.980094+0000","last_undegraded":"2024-09-10T11:47:28.980094+0000","last_fullsized":"2024-09-10T11:47:28.980094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027321+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:47:29.027321+0000","last_peered":"2024-09-10T11:47:29.027321+0000","last_clean":"2024-09-10T11:47:29.027321+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:47:29.027321+0000","last_undegraded":"2024-09-10T11:47:29.027321+0000","last_fullsized":"2024-09-10T11:47:29.027321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025838+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:47:29.025838+0000","last_peered":"2024-09-10T11:47:29.025838+0000","last_clean":"2024-09-10T11:47:29.025838+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:47:29.025838+0000","last_undegraded":"2024-09-10T11:47:29.025838+0000","last_fullsized":"2024-09-10T11:47:29.025838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025544+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:47:29.025544+0000","last_peered":"2024-09-10T11:47:29.025544+0000","last_clean":"2024-09-10T11:47:29.025544+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:47:29.025544+0000","last_undegraded":"2024-09-10T11:47:29.025544+0000","last_fullsized":"2024-09-10T11:47:29.025544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028088+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:47:29.028088+0000","last_peered":"2024-09-10T11:47:29.028088+0000","last_clean":"2024-09-10T11:47:29.028088+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:47:29.028088+0000","last_undegraded":"2024-09-10T11:47:29.028088+0000","last_fullsized":"2024-09-10T11:47:29.028088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027598+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:47:29.027598+0000","last_peered":"2024-09-10T11:47:29.027598+0000","last_clean":"2024-09-10T11:47:29.027598+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:47:29.027598+0000","last_undegraded":"2024-09-10T11:47:29.027598+0000","last_fullsized":"2024-09-10T11:47:29.027598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.734976+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:47:28.734976+0000","last_peered":"2024-09-10T11:47:28.734976+0000","last_clean":"2024-09-10T11:47:28.734976+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:47:28.734976+0000","last_undegraded":"2024-09-10T11:47:28.734976+0000","last_fullsized":"2024-09-10T11:47:28.734976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728711+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:47:28.728711+0000","last_peered":"2024-09-10T11:47:28.728711+0000","last_clean":"2024-09-10T11:47:28.728711+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:47:28.728711+0000","last_undegraded":"2024-09-10T11:47:28.728711+0000","last_fullsized":"2024-09-10T11:47:28.728711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729812+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:47:28.729812+0000","last_peered":"2024-09-10T11:47:28.729812+0000","last_clean":"2024-09-10T11:47:28.729812+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:47:28.729812+0000","last_undegraded":"2024-09-10T11:47:28.729812+0000","last_fullsized":"2024-09-10T11:47:28.729812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960859+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:47:28.960859+0000","last_peered":"2024-09-10T11:47:28.960859+0000","last_clean":"2024-09-10T11:47:28.960859+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:47:28.960859+0000","last_undegraded":"2024-09-10T11:47:28.960859+0000","last_fullsized":"2024-09-10T11:47:28.960859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729574+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:47:28.729574+0000","last_peered":"2024-09-10T11:47:28.729574+0000","last_clean":"2024-09-10T11:47:28.729574+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:47:28.729574+0000","last_undegraded":"2024-09-10T11:47:28.729574+0000","last_fullsized":"2024-09-10T11:47:28.729574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025283+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:47:29.025283+0000","last_peered":"2024-09-10T11:47:29.025283+0000","last_clean":"2024-09-10T11:47:29.025283+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:47:29.025283+0000","last_undegraded":"2024-09-10T11:47:29.025283+0000","last_fullsized":"2024-09-10T11:47:29.025283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737064+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:47:28.737064+0000","last_peered":"2024-09-10T11:47:28.737064+0000","last_clean":"2024-09-10T11:47:28.737064+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:47:28.737064+0000","last_undegraded":"2024-09-10T11:47:28.737064+0000","last_fullsized":"2024-09-10T11:47:28.737064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979793+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:47:28.979793+0000","last_peered":"2024-09-10T11:47:28.979793+0000","last_clean":"2024-09-10T11:47:28.979793+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:47:28.979793+0000","last_undegraded":"2024-09-10T11:47:28.979793+0000","last_fullsized":"2024-09-10T11:47:28.979793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735276+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:47:28.735276+0000","last_peered":"2024-09-10T11:47:28.735276+0000","last_clean":"2024-09-10T11:47:28.735276+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:47:28.735276+0000","last_undegraded":"2024-09-10T11:47:28.735276+0000","last_fullsized":"2024-09-10T11:47:28.735276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728453+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:47:28.728453+0000","last_peered":"2024-09-10T11:47:28.728453+0000","last_clean":"2024-09-10T11:47:28.728453+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:47:28.728453+0000","last_undegraded":"2024-09-10T11:47:28.728453+0000","last_fullsized":"2024-09-10T11:47:28.728453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735753+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:47:28.735753+0000","last_peered":"2024-09-10T11:47:28.735753+0000","last_clean":"2024-09-10T11:47:28.735753+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:47:28.735753+0000","last_undegraded":"2024-09-10T11:47:28.735753+0000","last_fullsized":"2024-09-10T11:47:28.735753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027230+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:47:29.027230+0000","last_peered":"2024-09-10T11:47:29.027230+0000","last_clean":"2024-09-10T11:47:29.027230+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:47:29.027230+0000","last_undegraded":"2024-09-10T11:47:29.027230+0000","last_fullsized":"2024-09-10T11:47:29.027230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028342+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:47:29.028342+0000","last_peered":"2024-09-10T11:47:29.028342+0000","last_clean":"2024-09-10T11:47:29.028342+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:47:29.028342+0000","last_undegraded":"2024-09-10T11:47:29.028342+0000","last_fullsized":"2024-09-10T11:47:29.028342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027954+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:47:29.027954+0000","last_peered":"2024-09-10T11:47:29.027954+0000","last_clean":"2024-09-10T11:47:29.027954+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:47:29.027954+0000","last_undegraded":"2024-09-10T11:47:29.027954+0000","last_fullsized":"2024-09-10T11:47:29.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735405+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:47:28.735405+0000","last_peered":"2024-09-10T11:47:28.735405+0000","last_clean":"2024-09-10T11:47:28.735405+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:47:28.735405+0000","last_undegraded":"2024-09-10T11:47:28.735405+0000","last_fullsized":"2024-09-10T11:47:28.735405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729094+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:47:28.729094+0000","last_peered":"2024-09-10T11:47:28.729094+0000","last_clean":"2024-09-10T11:47:28.729094+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:47:28.729094+0000","last_undegraded":"2024-09-10T11:47:28.729094+0000","last_fullsized":"2024-09-10T11:47:28.729094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960185+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:47:28.960185+0000","last_peered":"2024-09-10T11:47:28.960185+0000","last_clean":"2024-09-10T11:47:28.960185+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:47:28.960185+0000","last_undegraded":"2024-09-10T11:47:28.960185+0000","last_fullsized":"2024-09-10T11:47:28.960185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026051+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:47:29.026051+0000","last_peered":"2024-09-10T11:47:29.026051+0000","last_clean":"2024-09-10T11:47:29.026051+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:47:29.026051+0000","last_undegraded":"2024-09-10T11:47:29.026051+0000","last_fullsized":"2024-09-10T11:47:29.026051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979892+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:47:28.979892+0000","last_peered":"2024-09-10T11:47:28.979892+0000","last_clean":"2024-09-10T11:47:28.979892+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:47:28.979892+0000","last_undegraded":"2024-09-10T11:47:28.979892+0000","last_fullsized":"2024-09-10T11:47:28.979892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735001+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:47:28.735001+0000","last_peered":"2024-09-10T11:47:28.735001+0000","last_clean":"2024-09-10T11:47:28.735001+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:47:28.735001+0000","last_undegraded":"2024-09-10T11:47:28.735001+0000","last_fullsized":"2024-09-10T11:47:28.735001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737672+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:47:28.737672+0000","last_peered":"2024-09-10T11:47:28.737672+0000","last_clean":"2024-09-10T11:47:28.737672+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:47:28.737672+0000","last_undegraded":"2024-09-10T11:47:28.737672+0000","last_fullsized":"2024-09-10T11:47:28.737672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728990+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:47:28.728990+0000","last_peered":"2024-09-10T11:47:28.728990+0000","last_clean":"2024-09-10T11:47:28.728990+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:47:28.728990+0000","last_undegraded":"2024-09-10T11:47:28.728990+0000","last_fullsized":"2024-09-10T11:47:28.728990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027197+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:47:29.027197+0000","last_peered":"2024-09-10T11:47:29.027197+0000","last_clean":"2024-09-10T11:47:29.027197+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:47:29.027197+0000","last_undegraded":"2024-09-10T11:47:29.027197+0000","last_fullsized":"2024-09-10T11:47:29.027197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735590+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:47:28.735590+0000","last_peered":"2024-09-10T11:47:28.735590+0000","last_clean":"2024-09-10T11:47:28.735590+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:47:28.735590+0000","last_undegraded":"2024-09-10T11:47:28.735590+0000","last_fullsized":"2024-09-10T11:47:28.735590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728602+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:47:28.728602+0000","last_peered":"2024-09-10T11:47:28.728602+0000","last_clean":"2024-09-10T11:47:28.728602+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:47:28.728602+0000","last_undegraded":"2024-09-10T11:47:28.728602+0000","last_fullsized":"2024-09-10T11:47:28.728602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737137+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:47:28.737137+0000","last_peered":"2024-09-10T11:47:28.737137+0000","last_clean":"2024-09-10T11:47:28.737137+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:47:28.737137+0000","last_undegraded":"2024-09-10T11:47:28.737137+0000","last_fullsized":"2024-09-10T11:47:28.737137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979920+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:47:28.979920+0000","last_peered":"2024-09-10T11:47:28.979920+0000","last_clean":"2024-09-10T11:47:28.979920+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:47:28.979920+0000","last_undegraded":"2024-09-10T11:47:28.979920+0000","last_fullsized":"2024-09-10T11:47:28.979920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027801+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:47:29.027801+0000","last_peered":"2024-09-10T11:47:29.027801+0000","last_clean":"2024-09-10T11:47:29.027801+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:47:29.027801+0000","last_undegraded":"2024-09-10T11:47:29.027801+0000","last_fullsized":"2024-09-10T11:47:29.027801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025578+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:47:29.025578+0000","last_peered":"2024-09-10T11:47:29.025578+0000","last_clean":"2024-09-10T11:47:29.025578+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:47:29.025578+0000","last_undegraded":"2024-09-10T11:47:29.025578+0000","last_fullsized":"2024-09-10T11:47:29.025578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736301+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:47:28.736301+0000","last_peered":"2024-09-10T11:47:28.736301+0000","last_clean":"2024-09-10T11:47:28.736301+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:47:28.736301+0000","last_undegraded":"2024-09-10T11:47:28.736301+0000","last_fullsized":"2024-09-10T11:47:28.736301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960223+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:47:28.960223+0000","last_peered":"2024-09-10T11:47:28.960223+0000","last_clean":"2024-09-10T11:47:28.960223+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:47:28.960223+0000","last_undegraded":"2024-09-10T11:47:28.960223+0000","last_fullsized":"2024-09-10T11:47:28.960223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729007+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:47:28.729007+0000","last_peered":"2024-09-10T11:47:28.729007+0000","last_clean":"2024-09-10T11:47:28.729007+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:47:28.729007+0000","last_undegraded":"2024-09-10T11:47:28.729007+0000","last_fullsized":"2024-09-10T11:47:28.729007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026465+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:47:29.026465+0000","last_peered":"2024-09-10T11:47:29.026465+0000","last_clean":"2024-09-10T11:47:29.026465+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:47:29.026465+0000","last_undegraded":"2024-09-10T11:47:29.026465+0000","last_fullsized":"2024-09-10T11:47:29.026465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026349+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:47:29.026349+0000","last_peered":"2024-09-10T11:47:29.026349+0000","last_clean":"2024-09-10T11:47:29.026349+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:47:29.026349+0000","last_undegraded":"2024-09-10T11:47:29.026349+0000","last_fullsized":"2024-09-10T11:47:29.026349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960162+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:47:28.960162+0000","last_peered":"2024-09-10T11:47:28.960162+0000","last_clean":"2024-09-10T11:47:28.960162+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:47:28.960162+0000","last_undegraded":"2024-09-10T11:47:28.960162+0000","last_fullsized":"2024-09-10T11:47:28.960162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027867+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:47:29.027867+0000","last_peered":"2024-09-10T11:47:29.027867+0000","last_clean":"2024-09-10T11:47:29.027867+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:47:29.027867+0000","last_undegraded":"2024-09-10T11:47:29.027867+0000","last_fullsized":"2024-09-10T11:47:29.027867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729129+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:47:28.729129+0000","last_peered":"2024-09-10T11:47:28.729129+0000","last_clean":"2024-09-10T11:47:28.729129+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:47:28.729129+0000","last_undegraded":"2024-09-10T11:47:28.729129+0000","last_fullsized":"2024-09-10T11:47:28.729129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729289+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:47:28.729289+0000","last_peered":"2024-09-10T11:47:28.729289+0000","last_clean":"2024-09-10T11:47:28.729289+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:47:28.729289+0000","last_undegraded":"2024-09-10T11:47:28.729289+0000","last_fullsized":"2024-09-10T11:47:28.729289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025764+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:47:29.025764+0000","last_peered":"2024-09-10T11:47:29.025764+0000","last_clean":"2024-09-10T11:47:29.025764+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:47:29.025764+0000","last_undegraded":"2024-09-10T11:47:29.025764+0000","last_fullsized":"2024-09-10T11:47:29.025764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979529+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:47:28.979529+0000","last_peered":"2024-09-10T11:47:28.979529+0000","last_clean":"2024-09-10T11:47:28.979529+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:47:28.979529+0000","last_undegraded":"2024-09-10T11:47:28.979529+0000","last_fullsized":"2024-09-10T11:47:28.979529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736199+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:47:28.736199+0000","last_peered":"2024-09-10T11:47:28.736199+0000","last_clean":"2024-09-10T11:47:28.736199+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:47:28.736199+0000","last_undegraded":"2024-09-10T11:47:28.736199+0000","last_fullsized":"2024-09-10T11:47:28.736199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728908+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:47:28.728908+0000","last_peered":"2024-09-10T11:47:28.728908+0000","last_clean":"2024-09-10T11:47:28.728908+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:47:28.728908+0000","last_undegraded":"2024-09-10T11:47:28.728908+0000","last_fullsized":"2024-09-10T11:47:28.728908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027636+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:47:29.027636+0000","last_peered":"2024-09-10T11:47:29.027636+0000","last_clean":"2024-09-10T11:47:29.027636+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:47:29.027636+0000","last_undegraded":"2024-09-10T11:47:29.027636+0000","last_fullsized":"2024-09-10T11:47:29.027636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027946+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:47:29.027946+0000","last_peered":"2024-09-10T11:47:29.027946+0000","last_clean":"2024-09-10T11:47:29.027946+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:47:29.027946+0000","last_undegraded":"2024-09-10T11:47:29.027946+0000","last_fullsized":"2024-09-10T11:47:29.027946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737330+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:47:28.737330+0000","last_peered":"2024-09-10T11:47:28.737330+0000","last_clean":"2024-09-10T11:47:28.737330+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:47:28.737330+0000","last_undegraded":"2024-09-10T11:47:28.737330+0000","last_fullsized":"2024-09-10T11:47:28.737330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027844+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:47:29.027844+0000","last_peered":"2024-09-10T11:47:29.027844+0000","last_clean":"2024-09-10T11:47:29.027844+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:47:29.027844+0000","last_undegraded":"2024-09-10T11:47:29.027844+0000","last_fullsized":"2024-09-10T11:47:29.027844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735825+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:47:28.735825+0000","last_peered":"2024-09-10T11:47:28.735825+0000","last_clean":"2024-09-10T11:47:28.735825+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:47:28.735825+0000","last_undegraded":"2024-09-10T11:47:28.735825+0000","last_fullsized":"2024-09-10T11:47:28.735825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026767+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:47:29.026767+0000","last_peered":"2024-09-10T11:47:29.026767+0000","last_clean":"2024-09-10T11:47:29.026767+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:47:29.026767+0000","last_undegraded":"2024-09-10T11:47:29.026767+0000","last_fullsized":"2024-09-10T11:47:29.026767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028201+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:47:29.028201+0000","last_peered":"2024-09-10T11:47:29.028201+0000","last_clean":"2024-09-10T11:47:29.028201+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:47:29.028201+0000","last_undegraded":"2024-09-10T11:47:29.028201+0000","last_fullsized":"2024-09-10T11:47:29.028201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729404+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:47:28.729404+0000","last_peered":"2024-09-10T11:47:28.729404+0000","last_clean":"2024-09-10T11:47:28.729404+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:47:28.729404+0000","last_undegraded":"2024-09-10T11:47:28.729404+0000","last_fullsized":"2024-09-10T11:47:28.729404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979210+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:47:28.979210+0000","last_peered":"2024-09-10T11:47:28.979210+0000","last_clean":"2024-09-10T11:47:28.979210+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:47:28.979210+0000","last_undegraded":"2024-09-10T11:47:28.979210+0000","last_fullsized":"2024-09-10T11:47:28.979210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729364+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:47:28.729364+0000","last_peered":"2024-09-10T11:47:28.729364+0000","last_clean":"2024-09-10T11:47:28.729364+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:47:28.729364+0000","last_undegraded":"2024-09-10T11:47:28.729364+0000","last_fullsized":"2024-09-10T11:47:28.729364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737923+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:47:28.737923+0000","last_peered":"2024-09-10T11:47:28.737923+0000","last_clean":"2024-09-10T11:47:28.737923+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:47:28.737923+0000","last_undegraded":"2024-09-10T11:47:28.737923+0000","last_fullsized":"2024-09-10T11:47:28.737923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728742+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:47:28.728742+0000","last_peered":"2024-09-10T11:47:28.728742+0000","last_clean":"2024-09-10T11:47:28.728742+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:47:28.728742+0000","last_undegraded":"2024-09-10T11:47:28.728742+0000","last_fullsized":"2024-09-10T11:47:28.728742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027527+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:47:29.027527+0000","last_peered":"2024-09-10T11:47:29.027527+0000","last_clean":"2024-09-10T11:47:29.027527+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:47:29.027527+0000","last_undegraded":"2024-09-10T11:47:29.027527+0000","last_fullsized":"2024-09-10T11:47:29.027527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.959820+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:47:28.959820+0000","last_peered":"2024-09-10T11:47:28.959820+0000","last_clean":"2024-09-10T11:47:28.959820+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:47:28.959820+0000","last_undegraded":"2024-09-10T11:47:28.959820+0000","last_fullsized":"2024-09-10T11:47:28.959820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735428+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:47:28.735428+0000","last_peered":"2024-09-10T11:47:28.735428+0000","last_clean":"2024-09-10T11:47:28.735428+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:47:28.735428+0000","last_undegraded":"2024-09-10T11:47:28.735428+0000","last_fullsized":"2024-09-10T11:47:28.735428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729232+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:47:28.729232+0000","last_peered":"2024-09-10T11:47:28.729232+0000","last_clean":"2024-09-10T11:47:28.729232+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:47:28.729232+0000","last_undegraded":"2024-09-10T11:47:28.729232+0000","last_fullsized":"2024-09-10T11:47:28.729232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026538+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:47:29.026538+0000","last_peered":"2024-09-10T11:47:29.026538+0000","last_clean":"2024-09-10T11:47:29.026538+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:47:29.026538+0000","last_undegraded":"2024-09-10T11:47:29.026538+0000","last_fullsized":"2024-09-10T11:47:29.026538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.735750+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:47:28.735750+0000","last_peered":"2024-09-10T11:47:28.735750+0000","last_clean":"2024-09-10T11:47:28.735750+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:47:28.735750+0000","last_undegraded":"2024-09-10T11:47:28.735750+0000","last_fullsized":"2024-09-10T11:47:28.735750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027782+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:47:29.027782+0000","last_peered":"2024-09-10T11:47:29.027782+0000","last_clean":"2024-09-10T11:47:29.027782+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:47:29.027782+0000","last_undegraded":"2024-09-10T11:47:29.027782+0000","last_fullsized":"2024-09-10T11:47:29.027782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729583+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:47:28.729583+0000","last_peered":"2024-09-10T11:47:28.729583+0000","last_clean":"2024-09-10T11:47:28.729583+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:47:28.729583+0000","last_undegraded":"2024-09-10T11:47:28.729583+0000","last_fullsized":"2024-09-10T11:47:28.729583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.028075+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:47:29.028075+0000","last_peered":"2024-09-10T11:47:29.028075+0000","last_clean":"2024-09-10T11:47:29.028075+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:47:29.028075+0000","last_undegraded":"2024-09-10T11:47:29.028075+0000","last_fullsized":"2024-09-10T11:47:29.028075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737699+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:47:28.737699+0000","last_peered":"2024-09-10T11:47:28.737699+0000","last_clean":"2024-09-10T11:47:28.737699+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:47:28.737699+0000","last_undegraded":"2024-09-10T11:47:28.737699+0000","last_fullsized":"2024-09-10T11:47:28.737699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737759+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:47:28.737759+0000","last_peered":"2024-09-10T11:47:28.737759+0000","last_clean":"2024-09-10T11:47:28.737759+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:47:28.737759+0000","last_undegraded":"2024-09-10T11:47:28.737759+0000","last_fullsized":"2024-09-10T11:47:28.737759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729656+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:47:28.729656+0000","last_peered":"2024-09-10T11:47:28.729656+0000","last_clean":"2024-09-10T11:47:28.729656+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:47:28.729656+0000","last_undegraded":"2024-09-10T11:47:28.729656+0000","last_fullsized":"2024-09-10T11:47:28.729656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737163+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:47:28.737163+0000","last_peered":"2024-09-10T11:47:28.737163+0000","last_clean":"2024-09-10T11:47:28.737163+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:47:28.737163+0000","last_undegraded":"2024-09-10T11:47:28.737163+0000","last_fullsized":"2024-09-10T11:47:28.737163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.024602+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:47:29.024602+0000","last_peered":"2024-09-10T11:47:29.024602+0000","last_clean":"2024-09-10T11:47:29.024602+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:47:29.024602+0000","last_undegraded":"2024-09-10T11:47:29.024602+0000","last_fullsized":"2024-09-10T11:47:29.024602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728601+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:47:28.728601+0000","last_peered":"2024-09-10T11:47:28.728601+0000","last_clean":"2024-09-10T11:47:28.728601+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:47:28.728601+0000","last_undegraded":"2024-09-10T11:47:28.728601+0000","last_fullsized":"2024-09-10T11:47:28.728601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737189+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:47:28.737189+0000","last_peered":"2024-09-10T11:47:28.737189+0000","last_clean":"2024-09-10T11:47:28.737189+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:47:28.737189+0000","last_undegraded":"2024-09-10T11:47:28.737189+0000","last_fullsized":"2024-09-10T11:47:28.737189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736572+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:47:28.736572+0000","last_peered":"2024-09-10T11:47:28.736572+0000","last_clean":"2024-09-10T11:47:28.736572+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:47:28.736572+0000","last_undegraded":"2024-09-10T11:47:28.736572+0000","last_fullsized":"2024-09-10T11:47:28.736572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.027901+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:47:29.027901+0000","last_peered":"2024-09-10T11:47:29.027901+0000","last_clean":"2024-09-10T11:47:29.027901+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:47:29.027901+0000","last_undegraded":"2024-09-10T11:47:29.027901+0000","last_fullsized":"2024-09-10T11:47:29.027901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.960407+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:47:28.960407+0000","last_peered":"2024-09-10T11:47:28.960407+0000","last_clean":"2024-09-10T11:47:28.960407+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:47:28.960407+0000","last_undegraded":"2024-09-10T11:47:28.960407+0000","last_fullsized":"2024-09-10T11:47:28.960407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729246+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:47:28.729246+0000","last_peered":"2024-09-10T11:47:28.729246+0000","last_clean":"2024-09-10T11:47:28.729246+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:47:28.729246+0000","last_undegraded":"2024-09-10T11:47:28.729246+0000","last_fullsized":"2024-09-10T11:47:28.729246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.728919+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:47:28.728919+0000","last_peered":"2024-09-10T11:47:28.728919+0000","last_clean":"2024-09-10T11:47:28.728919+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:47:28.728919+0000","last_undegraded":"2024-09-10T11:47:28.728919+0000","last_fullsized":"2024-09-10T11:47:28.728919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.729488+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:47:28.729488+0000","last_peered":"2024-09-10T11:47:28.729488+0000","last_clean":"2024-09-10T11:47:28.729488+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:47:28.729488+0000","last_undegraded":"2024-09-10T11:47:28.729488+0000","last_fullsized":"2024-09-10T11:47:28.729488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.025710+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:47:29.025710+0000","last_peered":"2024-09-10T11:47:29.025710+0000","last_clean":"2024-09-10T11:47:29.025710+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:47:29.025710+0000","last_undegraded":"2024-09-10T11:47:29.025710+0000","last_fullsized":"2024-09-10T11:47:29.025710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.979544+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:47:28.979544+0000","last_peered":"2024-09-10T11:47:28.979544+0000","last_clean":"2024-09-10T11:47:28.979544+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:47:28.979544+0000","last_undegraded":"2024-09-10T11:47:28.979544+0000","last_fullsized":"2024-09-10T11:47:28.979544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:29.026498+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:47:29.026498+0000","last_peered":"2024-09-10T11:47:29.026498+0000","last_clean":"2024-09-10T11:47:29.026498+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:47:29.026498+0000","last_undegraded":"2024-09-10T11:47:29.026498+0000","last_fullsized":"2024-09-10T11:47:29.026498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736130+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:47:28.736130+0000","last_peered":"2024-09-10T11:47:28.736130+0000","last_clean":"2024-09-10T11:47:28.736130+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:47:28.736130+0000","last_undegraded":"2024-09-10T11:47:28.736130+0000","last_fullsized":"2024-09-10T11:47:28.736130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.736743+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:47:28.736743+0000","last_peered":"2024-09-10T11:47:28.736743+0000","last_clean":"2024-09-10T11:47:28.736743+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:47:28.736743+0000","last_undegraded":"2024-09-10T11:47:28.736743+0000","last_fullsized":"2024-09-10T11:47:28.736743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737047+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:47:28.737047+0000","last_peered":"2024-09-10T11:47:28.737047+0000","last_clean":"2024-09-10T11:47:28.737047+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:47:28.737047+0000","last_undegraded":"2024-09-10T11:47:28.737047+0000","last_fullsized":"2024-09-10T11:47:28.737047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:47:28.737522+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:47:28.737522+0000","last_peered":"2024-09-10T11:47:28.737522+0000","last_clean":"2024-09-10T11:47:28.737522+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:47:28.737522+0000","last_undegraded":"2024-09-10T11:47:28.737522+0000","last_fullsized":"2024-09-10T11:47:28.737522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:47:38.228 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T11:47:38.228 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T11:47:38.228 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T11:47:38.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 -- 172.21.15.78:0/2407543455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc001582b0 msgr2=0x7fcc000b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 --2- 172.21.15.78:0/2407543455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc001582b0 0x7fcc000b44a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcc000b5540 tx=0x7fcbfc01ccf0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 -- 172.21.15.78:0/2407543455 shutdown_connections 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 --2- 172.21.15.78:0/2407543455 >> v2:172.21.15.112:3300/0 conn(0x7fcc000b49e0 0x7fcc0006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 --2- 172.21.15.78:0/2407543455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc001582b0 0x7fcc000b44a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 -- 172.21.15.78:0/2407543455 >> 172.21.15.78:0/2407543455 conn(0x7fcc000cf7c0 msgr2=0x7fcc000cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 -- 172.21.15.78:0/2407543455 shutdown_connections 2024-09-10T11:47:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.382+0000 7fcc07e81640 1 -- 172.21.15.78:0/2407543455 wait complete. 2024-09-10T11:47:38.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 Processor -- start 2024-09-10T11:47:38.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- start start 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc0006fdb0 0x7fcc00149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 0x7fcc0014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc001582b0 0x7fcc000ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc001677f0 con 0x7fcc000b49e0 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc00167670 con 0x7fcc001582b0 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcc00167970 con 0x7fcc0006fdb0 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 0x7fcc0014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 0x7fcc0014c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55320/0 (socket says 172.21.15.78:55320) 2024-09-10T11:47:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 -- 172.21.15.78:0/1556026332 learned_addr learned my addr 172.21.15.78:0/1556026332 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0641e640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc001582b0 0x7fcc000ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc05c1d640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc0006fdb0 0x7fcc00149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 -- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc0006fdb0 msgr2=0x7fcc00149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc0006fdb0 0x7fcc00149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 -- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc001582b0 msgr2=0x7fcc000ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc001582b0 0x7fcc000ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 -- 172.21.15.78:0/1556026332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc001fb950 con 0x7fcc000b49e0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc0541c640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 0x7fcc0014c280 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c970 tx=0x7fcbf000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0007bb0 con 0x7fcc000b49e0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbf0005020 con 0x7fcc000b49e0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc001fab90 con 0x7fcc000b49e0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0007e60 con 0x7fcc000b49e0 2024-09-10T11:47:38.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc001fb150 con 0x7fcc000b49e0 2024-09-10T11:47:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.386+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0006f870 con 0x7fcc000b49e0 2024-09-10T11:47:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.390+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fcbf0005470 con 0x7fcc000b49e0 2024-09-10T11:47:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.390+0000 7fcbf67fc640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbe406f710 0x7fcbe4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.390+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcbf0090080 con 0x7fcc000b49e0 2024-09-10T11:47:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.390+0000 7fcc05c1d640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbe406f710 0x7fcbe4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.390+0000 7fcc05c1d640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbe406f710 0x7fcbe4071bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0af000 tx=0x7fcbfc01b530 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.390+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fcbf0014030 con 0x7fcc000b49e0 2024-09-10T11:47:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.558+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcc0015d550 con 0x7fcc000b49e0 2024-09-10T11:47:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.558+0000 7fcbf67fc640 1 -- 172.21.15.78:0/1556026332 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fcbf005d130 con 0x7fcc000b49e0 2024-09-10T11:47:38.562 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:38.562 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbe406f710 msgr2=0x7fcbe4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbe406f710 0x7fcbe4071bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0af000 tx=0x7fcbfc01b530 comp rx=0 tx=0).stop 2024-09-10T11:47:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 msgr2=0x7fcc0014c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 0x7fcc0014c280 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c970 tx=0x7fcbf000ce30 comp rx=0 tx=0).stop 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 shutdown_connections 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc001582b0 0x7fcc000ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbe406f710 0x7fcbe4071bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc000b49e0 0x7fcc0014c280 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 --2- 172.21.15.78:0/1556026332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc0006fdb0 0x7fcc00149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 >> 172.21.15.78:0/1556026332 conn(0x7fcc000cf7c0 msgr2=0x7fcc0014b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 shutdown_connections 2024-09-10T11:47:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:38.562+0000 7fcc07e81640 1 -- 172.21.15.78:0/1556026332 wait complete. 2024-09-10T11:47:41.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 -- 172.21.15.78:0/2952912691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 msgr2=0x7ff8d40b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 --2- 172.21.15.78:0/2952912691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d40b3b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40702d0 tx=0x7ff8cc01ccc0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 -- 172.21.15.78:0/2952912691 shutdown_connections 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 --2- 172.21.15.78:0/2952912691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d40b3b10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 --2- 172.21.15.78:0/2952912691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8d415a010 0x7ff8d40b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 --2- 172.21.15.78:0/2952912691 >> v2:172.21.15.112:3300/0 conn(0x7ff8d4159c30 0x7ff8d40b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 -- 172.21.15.78:0/2952912691 >> 172.21.15.78:0/2952912691 conn(0x7ff8d40cf7c0 msgr2=0x7ff8d40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 -- 172.21.15.78:0/2952912691 shutdown_connections 2024-09-10T11:47:41.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.714+0000 7ff8da05c640 1 -- 172.21.15.78:0/2952912691 wait complete. 2024-09-10T11:47:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 Processor -- start 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- start start 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8d4159c30 0x7ff8d414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8d415a010 0x7ff8d4166440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d406ee50 con 0x7ff8d40aef20 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d415e840 con 0x7ff8d4159c30 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d406efd0 con 0x7ff8d415a010 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51486/0 (socket says 172.21.15.78:51486) 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 -- 172.21.15.78:0/64513916 learned_addr learned my addr 172.21.15.78:0/64513916 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d2ffd640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8d4159c30 0x7ff8d414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d3fff640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8d415a010 0x7ff8d4166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 -- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8d415a010 msgr2=0x7ff8d4166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8d415a010 0x7ff8d4166440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 -- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8d4159c30 msgr2=0x7ff8d414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8d4159c30 0x7ff8d414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 -- 172.21.15.78:0/64513916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d41fb310 con 0x7ff8d40aef20 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d2ffd640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8d4159c30 0x7ff8d414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8d37fe640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d415aa80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c970 tx=0x7ff8c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4007c70 con 0x7ff8d40aef20 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8c400f450 con 0x7ff8d40aef20 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400f8a0 con 0x7ff8d40aef20 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d41fb5f0 con 0x7ff8d40aef20 2024-09-10T11:47:41.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41fbbb0 con 0x7ff8d40aef20 2024-09-10T11:47:41.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.718+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b40052a0 con 0x7ff8d40aef20 2024-09-10T11:47:41.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.722+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7ff8c400fa40 con 0x7ff8d40aef20 2024-09-10T11:47:41.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.722+0000 7ff8bbfff640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff8c006f710 0x7ff8c0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:41.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.722+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8c4090070 con 0x7ff8d40aef20 2024-09-10T11:47:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.722+0000 7ff8d2ffd640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff8c006f710 0x7ff8c0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.722+0000 7ff8d2ffd640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff8c006f710 0x7ff8c0071bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8005fd0 tx=0x7ff8c8005d40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:41.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.726+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7ff8c4014030 con 0x7ff8d40aef20 2024-09-10T11:47:41.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8b4005590 con 0x7ff8d40aef20 2024-09-10T11:47:41.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8bbfff640 1 -- 172.21.15.78:0/64513916 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ff8c405cfb0 con 0x7ff8d40aef20 2024-09-10T11:47:41.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:41.912 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff8c006f710 msgr2=0x7ff8c0071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff8c006f710 0x7ff8c0071bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8005fd0 tx=0x7ff8c8005d40 comp rx=0 tx=0).stop 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 msgr2=0x7ff8d415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d415aa80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c970 tx=0x7ff8c400ce30 comp rx=0 tx=0).stop 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 shutdown_connections 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8d4159c30 0x7ff8d414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff8c006f710 0x7ff8c0071bd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8d415a010 0x7ff8d4166440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 --2- 172.21.15.78:0/64513916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d40aef20 0x7ff8d415aa80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:41.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 >> 172.21.15.78:0/64513916 conn(0x7ff8d40cf7c0 msgr2=0x7ff8d4153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:41.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 shutdown_connections 2024-09-10T11:47:41.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:41.910+0000 7ff8da05c640 1 -- 172.21.15.78:0/64513916 wait complete. 2024-09-10T11:47:44.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:45.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.066+0000 7f2b4e83c640 1 -- 172.21.15.78:0/238143066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b4815a580 msgr2=0x7f2b48071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.066+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/238143066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b4815a580 0x7f2b48071f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009840 tx=0x7f2b3801c710 comp rx=0 tx=0).stop 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.066+0000 7f2b4e83c640 1 -- 172.21.15.78:0/238143066 shutdown_connections 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.066+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/238143066 >> v2:172.21.15.112:3300/0 conn(0x7f2b4806ff80 0x7f2b4815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.066+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/238143066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b4815a580 0x7f2b48071f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.066+0000 7f2b4e83c640 1 -- 172.21.15.78:0/238143066 >> 172.21.15.78:0/238143066 conn(0x7f2b480cf7c0 msgr2=0x7f2b480cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- 172.21.15.78:0/238143066 shutdown_connections 2024-09-10T11:47:45.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- 172.21.15.78:0/238143066 wait complete. 2024-09-10T11:47:45.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 Processor -- start 2024-09-10T11:47:45.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- start start 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 0x7f2b48150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b480732d0 0x7f2b481568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4815a580 0x7f2b48156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2b48167590 con 0x7f2b4806ff80 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4815d880 con 0x7f2b4815a580 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2b48167710 con 0x7f2b480732d0 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 0x7f2b48150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 0x7f2b48150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51490/0 (socket says 172.21.15.78:51490) 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 -- 172.21.15.78:0/1982004057 learned_addr learned my addr 172.21.15.78:0/1982004057 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b477fe640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b480732d0 0x7f2b481568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4cdd9640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4815a580 0x7f2b48156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 -- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b480732d0 msgr2=0x7f2b481568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b480732d0 0x7f2b481568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 -- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4815a580 msgr2=0x7f2b48156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4815a580 0x7f2b48156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 -- 172.21.15.78:0/1982004057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4814f2c0 con 0x7f2b4806ff80 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b477fe640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b480732d0 0x7f2b481568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b47fff640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 0x7f2b48150360 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2b3801c540 tx=0x7f2b380052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b380ac050 con 0x7f2b4806ff80 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b380046d0 con 0x7f2b4806ff80 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4814f5a0 con 0x7f2b4806ff80 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38004b00 con 0x7f2b4806ff80 2024-09-10T11:47:45.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4814fb60 con 0x7f2b4806ff80 2024-09-10T11:47:45.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.070+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4815c5a0 con 0x7f2b4806ff80 2024-09-10T11:47:45.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.074+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f2b380af070 con 0x7f2b4806ff80 2024-09-10T11:47:45.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.074+0000 7f2b44ff9640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2b3406f710 0x7f2b34071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:45.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.074+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2b381294a0 con 0x7f2b4806ff80 2024-09-10T11:47:45.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.074+0000 7f2b477fe640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2b3406f710 0x7f2b34071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:45.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.074+0000 7f2b477fe640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2b3406f710 0x7f2b34071bd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b48151c60 tx=0x7f2b3c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:45.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.078+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f2b380c2030 con 0x7f2b4806ff80 2024-09-10T11:47:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b480cc0c0 con 0x7f2b4806ff80 2024-09-10T11:47:45.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b44ff9640 1 -- 172.21.15.78:0/1982004057 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f2b38016330 con 0x7f2b4806ff80 2024-09-10T11:47:45.260 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:45.260 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2b3406f710 msgr2=0x7f2b34071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2b3406f710 0x7f2b34071bd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b48151c60 tx=0x7f2b3c009040 comp rx=0 tx=0).stop 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 msgr2=0x7f2b48150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 0x7f2b48150360 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2b3801c540 tx=0x7f2b380052a0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 shutdown_connections 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4815a580 0x7f2b48156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2b3406f710 0x7f2b34071bd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b480732d0 0x7f2b481568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 --2- 172.21.15.78:0/1982004057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4806ff80 0x7f2b48150360 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 >> 172.21.15.78:0/1982004057 conn(0x7f2b480cf7c0 msgr2=0x7f2b480b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 shutdown_connections 2024-09-10T11:47:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:45.258+0000 7f2b4e83c640 1 -- 172.21.15.78:0/1982004057 wait complete. 2024-09-10T11:47:48.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3644671023 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e4161630 msgr2=0x7fd1e40d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3644671023 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e4161630 0x7fd1e40d4770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009840 tx=0x7fd1d401c7f0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3644671023 shutdown_connections 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3644671023 >> v2:172.21.15.112:3300/0 conn(0x7fd1e40b4a10 0x7fd1e40b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3644671023 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e4161630 0x7fd1e40d4770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3644671023 >> 172.21.15.78:0/3644671023 conn(0x7fd1e40d3c80 msgr2=0x7fd1e40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3644671023 shutdown_connections 2024-09-10T11:47:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3644671023 wait complete. 2024-09-10T11:47:48.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 Processor -- start 2024-09-10T11:47:48.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- start start 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e40b4a10 0x7fd1e4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 0x7fd1e41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1e4161630 0x7fd1e4159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e416acc0 con 0x7fd1e4161250 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e416ab40 con 0x7fd1e4161630 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1eb56c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e416ae40 con 0x7fd1e40b4a10 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1e8b07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 0x7fd1e41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1e8b07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 0x7fd1e41591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51498/0 (socket says 172.21.15.78:51498) 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.414+0000 7fd1e8b07640 1 -- 172.21.15.78:0/3401557804 learned_addr learned my addr 172.21.15.78:0/3401557804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e9b09640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1e4161630 0x7fd1e4159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e9308640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e40b4a10 0x7fd1e4153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e8b07640 1 -- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e40b4a10 msgr2=0x7fd1e4153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e8b07640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e40b4a10 0x7fd1e4153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e8b07640 1 -- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1e4161630 msgr2=0x7fd1e4159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e8b07640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1e4161630 0x7fd1e4159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e8b07640 1 -- 172.21.15.78:0/3401557804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e41f8470 con 0x7fd1e4161250 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e9308640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e40b4a10 0x7fd1e4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e8b07640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 0x7fd1e41591d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009790 tx=0x7fd1d40a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40bc070 con 0x7fd1e4161250 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e41532a0 con 0x7fd1e4161250 2024-09-10T11:47:48.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1d4004470 con 0x7fd1e4161250 2024-09-10T11:47:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e4153860 con 0x7fd1e4161250 2024-09-10T11:47:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40b2040 con 0x7fd1e4161250 2024-09-10T11:47:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e40b33a0 con 0x7fd1e4161250 2024-09-10T11:47:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd1d4003860 con 0x7fd1e4161250 2024-09-10T11:47:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1d9ffb640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd1c806f710 0x7fd1c8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd1d41291a0 con 0x7fd1e4161250 2024-09-10T11:47:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.418+0000 7fd1e9308640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd1c806f710 0x7fd1c8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.422+0000 7fd1e9308640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd1c806f710 0x7fd1c8071bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1e415c870 tx=0x7fd1e0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:48.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.426+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd1d4016410 con 0x7fd1e4161250 2024-09-10T11:47:48.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.598+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd1e40b64d0 con 0x7fd1e4161250 2024-09-10T11:47:48.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.598+0000 7fd1d9ffb640 1 -- 172.21.15.78:0/3401557804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd1d40f5aa0 con 0x7fd1e4161250 2024-09-10T11:47:48.601 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:48.601 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:48.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd1c806f710 msgr2=0x7fd1c8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd1c806f710 0x7fd1c8071bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1e415c870 tx=0x7fd1e0009040 comp rx=0 tx=0).stop 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 msgr2=0x7fd1e41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 0x7fd1e41591d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009790 tx=0x7fd1d40a5640 comp rx=0 tx=0).stop 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 shutdown_connections 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1e4161630 0x7fd1e4159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd1c806f710 0x7fd1c8071bd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e4161250 0x7fd1e41591d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 --2- 172.21.15.78:0/3401557804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1e40b4a10 0x7fd1e4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 >> 172.21.15.78:0/3401557804 conn(0x7fd1e40d3c80 msgr2=0x7fd1e40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 shutdown_connections 2024-09-10T11:47:48.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:48.602+0000 7fd1eb56c640 1 -- 172.21.15.78:0/3401557804 wait complete. 2024-09-10T11:47:49.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:47:49.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:47:51.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:51.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- 172.21.15.78:0/630259117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b1290 msgr2=0x7f4b500b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:51.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 --2- 172.21.15.78:0/630259117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b1290 0x7f4b500b1720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009bc0 tx=0x7f4b4801cb70 comp rx=0 tx=0).stop 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- 172.21.15.78:0/630259117 shutdown_connections 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 --2- 172.21.15.78:0/630259117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b1290 0x7f4b500b1720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 --2- 172.21.15.78:0/630259117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b500b4c50 0x7f4b500d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- 172.21.15.78:0/630259117 >> 172.21.15.78:0/630259117 conn(0x7f4b500d3c00 msgr2=0x7f4b500d4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- 172.21.15.78:0/630259117 shutdown_connections 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- 172.21.15.78:0/630259117 wait complete. 2024-09-10T11:47:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 Processor -- start 2024-09-10T11:47:51.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- start start 2024-09-10T11:47:51.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 0x7f4b50153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:51.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b4c50 0x7f4b50155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b501612f0 0x7f4b50152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5016ad50 con 0x7f4b500b1290 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5016abd0 con 0x7f4b500b4c50 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b5788b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5016aed0 con 0x7f4b501612f0 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 0x7f4b50153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 0x7f4b50153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49504/0 (socket says 172.21.15.78:49504) 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 -- 172.21.15.78:0/3411637765 learned_addr learned my addr 172.21.15.78:0/3411637765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55e28640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b501612f0 0x7f4b50152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b54e26640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b4c50 0x7f4b50155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 -- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b501612f0 msgr2=0x7f4b50152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b501612f0 0x7f4b50152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 -- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b4c50 msgr2=0x7f4b50155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b4c50 0x7f4b50155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 -- 172.21.15.78:0/3411637765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500d13c0 con 0x7f4b500b1290 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b55627640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 0x7f4b50153fa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c4c0 tx=0x7f4b4c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.754+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c016020 con 0x7f4b500b1290 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b4c012940 con 0x7f4b500b1290 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c012d90 con 0x7f4b500b1290 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b50154980 con 0x7f4b500b1290 2024-09-10T11:47:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b50154c20 con 0x7f4b500b1290 2024-09-10T11:47:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b500b1720 con 0x7f4b500b1290 2024-09-10T11:47:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f4b4c019020 con 0x7f4b500b1290 2024-09-10T11:47:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b45ffb640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4b3406f710 0x7f4b34071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4b4c08f8a0 con 0x7f4b500b1290 2024-09-10T11:47:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b54e26640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4b3406f710 0x7f4b34071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.758+0000 7f4b54e26640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4b3406f710 0x7f4b34071bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009600 tx=0x7f4b400091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:51.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.762+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f4b4c020020 con 0x7f4b500b1290 2024-09-10T11:47:51.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.942+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4b50075e50 con 0x7f4b500b1290 2024-09-10T11:47:51.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.942+0000 7f4b45ffb640 1 -- 172.21.15.78:0/3411637765 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f4b4c05c8a0 con 0x7f4b500b1290 2024-09-10T11:47:51.946 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:51.946 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4b3406f710 msgr2=0x7f4b34071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4b3406f710 0x7f4b34071bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009600 tx=0x7f4b400091e0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 msgr2=0x7f4b50153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 0x7f4b50153fa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c4c0 tx=0x7f4b4c00c980 comp rx=0 tx=0).stop 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 shutdown_connections 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500b4c50 0x7f4b50155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4b3406f710 0x7f4b34071bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b501612f0 0x7f4b50152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 --2- 172.21.15.78:0/3411637765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b500b1290 0x7f4b50153fa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:51.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 >> 172.21.15.78:0/3411637765 conn(0x7f4b500d3c00 msgr2=0x7f4b500cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:51.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 shutdown_connections 2024-09-10T11:47:51.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:51.946+0000 7f4b5788b640 1 -- 172.21.15.78:0/3411637765 wait complete. 2024-09-10T11:47:54.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 -- 172.21.15.78:0/2457159494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9015f270 msgr2=0x7f9b9015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 --2- 172.21.15.78:0/2457159494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9015f270 0x7f9b9015f650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ae6e0 tx=0x7f9b8001f0b0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 -- 172.21.15.78:0/2457159494 shutdown_connections 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 --2- 172.21.15.78:0/2457159494 >> v2:172.21.15.112:3300/0 conn(0x7f9b9015bc80 0x7f9b9015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 --2- 172.21.15.78:0/2457159494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b9006ded0 0x7f9b9006e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 --2- 172.21.15.78:0/2457159494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9015f270 0x7f9b9015f650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 -- 172.21.15.78:0/2457159494 >> 172.21.15.78:0/2457159494 conn(0x7f9b900cf7c0 msgr2=0x7f9b900cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 -- 172.21.15.78:0/2457159494 shutdown_connections 2024-09-10T11:47:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.094+0000 7f9b9712c640 1 -- 172.21.15.78:0/2457159494 wait complete. 2024-09-10T11:47:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 Processor -- start 2024-09-10T11:47:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- start start 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 0x7f9b9014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b9015bc80 0x7f9b9013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b9015f270 0x7f9b90155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9015c760 con 0x7f9b9006ded0 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9015c5e0 con 0x7f9b9015f270 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9015c8e0 con 0x7f9b9015bc80 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 0x7f9b9014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 0x7f9b9014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49520/0 (socket says 172.21.15.78:49520) 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 -- 172.21.15.78:0/1893305010 learned_addr learned my addr 172.21.15.78:0/1893305010 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 -- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b9015bc80 msgr2=0x7f9b9013d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b8ffff640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b9015bc80 0x7f9b9013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b9015bc80 0x7f9b9013d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b956c9640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b9015f270 0x7f9b90155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 -- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b9015f270 msgr2=0x7f9b90155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b9015f270 0x7f9b90155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 -- 172.21.15.78:0/1893305010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9014f490 con 0x7f9b9006ded0 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b956c9640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b9015f270 0x7f9b90155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b94ec8640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 0x7f9b9014ec10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9b800b3040 tx=0x7f9b800a8c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800bf020 con 0x7f9b9006ded0 2024-09-10T11:47:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b80003970 con 0x7f9b9006ded0 2024-09-10T11:47:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b90152f60 con 0x7f9b9006ded0 2024-09-10T11:47:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800b5040 con 0x7f9b9006ded0 2024-09-10T11:47:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b90153520 con 0x7f9b9006ded0 2024-09-10T11:47:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.098+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b90152d70 con 0x7f9b9006ded0 2024-09-10T11:47:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.102+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f9b800c2070 con 0x7f9b9006ded0 2024-09-10T11:47:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.102+0000 7f9b8d7fa640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9b7c06f710 0x7f9b7c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.102+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9b8012cdf0 con 0x7f9b9006ded0 2024-09-10T11:47:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.102+0000 7f9b8ffff640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9b7c06f710 0x7f9b7c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.102+0000 7f9b8ffff640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9b7c06f710 0x7f9b7c071bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b9015dca0 tx=0x7f9b84008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:55.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.106+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f9b80018c10 con 0x7f9b9006ded0 2024-09-10T11:47:55.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9b9015ead0 con 0x7f9b9006ded0 2024-09-10T11:47:55.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b8d7fa640 1 -- 172.21.15.78:0/1893305010 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f9b800f9dc0 con 0x7f9b9006ded0 2024-09-10T11:47:55.284 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:55.284 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9b7c06f710 msgr2=0x7f9b7c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9b7c06f710 0x7f9b7c071bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b9015dca0 tx=0x7f9b84008040 comp rx=0 tx=0).stop 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 msgr2=0x7f9b9014ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 0x7f9b9014ec10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9b800b3040 tx=0x7f9b800a8c80 comp rx=0 tx=0).stop 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 shutdown_connections 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b9015f270 0x7f9b90155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9b7c06f710 0x7f9b7c071bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b9015bc80 0x7f9b9013d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 --2- 172.21.15.78:0/1893305010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006ded0 0x7f9b9014ec10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:55.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 >> 172.21.15.78:0/1893305010 conn(0x7f9b900cf7c0 msgr2=0x7f9b9015e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:55.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 shutdown_connections 2024-09-10T11:47:55.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:55.282+0000 7f9b9712c640 1 -- 172.21.15.78:0/1893305010 wait complete. 2024-09-10T11:47:58.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:47:58.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/4134105191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 msgr2=0x7facc0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:58.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 --2- 172.21.15.78:0/4134105191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facc0004c90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facd0005fd0 tx=0x7facd001cd20 comp rx=0 tx=0).stop 2024-09-10T11:47:58.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd9ee6640 1 -- 172.21.15.78:0/4134105191 reap_dead start 2024-09-10T11:47:58.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/4134105191 shutdown_connections 2024-09-10T11:47:58.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/4134105191 >> 172.21.15.78:0/4134105191 conn(0x7facd40d3c80 msgr2=0x7facd40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:58.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/4134105191 shutdown_connections 2024-09-10T11:47:58.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/4134105191 wait complete. 2024-09-10T11:47:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 Processor -- start 2024-09-10T11:47:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- start start 2024-09-10T11:47:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facd40ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7facd40b8e10 0x7facd4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facd41e8aa0 0x7facd41e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7facd40d22f0 con 0x7facc0004810 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7facd40d2170 con 0x7facd41e8aa0 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7facd40d2470 con 0x7facd40b8e10 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facd40ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facd40ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49548/0 (socket says 172.21.15.78:49548) 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 -- 172.21.15.78:0/1975553037 learned_addr learned my addr 172.21.15.78:0/1975553037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd8ee4640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7facd40b8e10 0x7facd4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd9ee6640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facd41e8aa0 0x7facd41e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 -- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7facd40b8e10 msgr2=0x7facd4157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7facd40b8e10 0x7facd4157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 -- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facd41e8aa0 msgr2=0x7facd41e8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facd41e8aa0 0x7facd41e8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 -- 172.21.15.78:0/1975553037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd4157880 con 0x7facc0004810 2024-09-10T11:47:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd8ee4640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7facd40b8e10 0x7facd4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facd96e5640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facd40ca340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7facc400e9f0 tx=0x7facc400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc400cc00 con 0x7facc0004810 2024-09-10T11:47:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facc400ce90 con 0x7facc0004810 2024-09-10T11:47:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd40caa20 con 0x7facc0004810 2024-09-10T11:47:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc40116b0 con 0x7facc0004810 2024-09-10T11:47:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.434+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd41f4af0 con 0x7facc0004810 2024-09-10T11:47:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.438+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd40d4770 con 0x7facc0004810 2024-09-10T11:47:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.438+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7facc4011850 con 0x7facc0004810 2024-09-10T11:47:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.438+0000 7facc9ffb640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7facb806f740 0x7facb8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.438+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7facc40902d0 con 0x7facc0004810 2024-09-10T11:47:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.438+0000 7facd8ee4640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7facb806f740 0x7facb8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.438+0000 7facd8ee4640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7facb806f740 0x7facb8071c00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facd00b0000 tx=0x7facd0019ac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:58.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.442+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7facc4016030 con 0x7facc0004810 2024-09-10T11:47:58.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.622+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7facd406e250 con 0x7facc0004810 2024-09-10T11:47:58.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.622+0000 7facc9ffb640 1 -- 172.21.15.78:0/1975553037 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7facc405d210 con 0x7facc0004810 2024-09-10T11:47:58.625 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:47:58.625 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:47:58.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.622+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7facb806f740 msgr2=0x7facb8071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:58.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.622+0000 7facdb949640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7facb806f740 0x7facb8071c00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facd00b0000 tx=0x7facd0019ac0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.622+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 msgr2=0x7facd40ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:58.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.622+0000 7facdb949640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facd40ca340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7facc400e9f0 tx=0x7facc400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 shutdown_connections 2024-09-10T11:47:58.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facd41e8aa0 0x7facd41e8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7facb806f740 0x7facb8071c00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7facd40b8e10 0x7facd4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 --2- 172.21.15.78:0/1975553037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc0004810 0x7facd40ca340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:58.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 >> 172.21.15.78:0/1975553037 conn(0x7facd40d3c80 msgr2=0x7facd40d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:58.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 shutdown_connections 2024-09-10T11:47:58.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:47:58.626+0000 7facdb949640 1 -- 172.21.15.78:0/1975553037 wait complete. 2024-09-10T11:48:01.643 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 -- 172.21.15.78:0/133781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886806ff80 msgr2=0x7f8868165370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 --2- 172.21.15.78:0/133781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886806ff80 0x7f8868165370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8860009bc0 tx=0x7f886001cb70 comp rx=0 tx=0).stop 2024-09-10T11:48:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 -- 172.21.15.78:0/133781228 shutdown_connections 2024-09-10T11:48:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 --2- 172.21.15.78:0/133781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886806ff80 0x7f8868165370 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 -- 172.21.15.78:0/133781228 >> 172.21.15.78:0/133781228 conn(0x7f88680cf7c0 msgr2=0x7f88680cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 -- 172.21.15.78:0/133781228 shutdown_connections 2024-09-10T11:48:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 -- 172.21.15.78:0/133781228 wait complete. 2024-09-10T11:48:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 Processor -- start 2024-09-10T11:48:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.778+0000 7f886e33b640 1 -- start start 2024-09-10T11:48:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f886806ff80 0x7f886814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88680732d0 0x7f8868157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 0x7f886806e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8868168de0 con 0x7f886815a580 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8868168c60 con 0x7f886806ff80 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8868168f60 con 0x7f88680732d0 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 0x7f886806e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 0x7f886806e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57506/0 (socket says 172.21.15.78:57506) 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 -- 172.21.15.78:0/136833398 learned_addr learned my addr 172.21.15.78:0/136833398 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8867fff640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f886806ff80 0x7f886814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f88677fe640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88680732d0 0x7f8868157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 -- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88680732d0 msgr2=0x7f8868157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88680732d0 0x7f8868157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 -- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f886806ff80 msgr2=0x7f886814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f886806ff80 0x7f886814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 -- 172.21.15.78:0/136833398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88681f9b00 con 0x7f886815a580 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8867fff640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f886806ff80 0x7f886814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886c8d8640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 0x7f886806e760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f886001c5e0 tx=0x7f8860005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88600b2040 con 0x7f886815a580 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88600bb070 con 0x7f886815a580 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8868147080 con 0x7f886815a580 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860004370 con 0x7f886815a580 2024-09-10T11:48:01.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88681f8d40 con 0x7f886815a580 2024-09-10T11:48:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f886806f870 con 0x7f886815a580 2024-09-10T11:48:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f8860004510 con 0x7f886815a580 2024-09-10T11:48:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8864ff9640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f884806f710 0x7f8848071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f886012a0a0 con 0x7f886815a580 2024-09-10T11:48:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.782+0000 7f8867fff640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f884806f710 0x7f8848071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.786+0000 7f8867fff640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f884806f710 0x7f8848071bd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8850001230 tx=0x7f8850009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.786+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f8868147080 con 0x7f886815a580 2024-09-10T11:48:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.962+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8868157f50 con 0x7f886815a580 2024-09-10T11:48:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f8864ff9640 1 -- 172.21.15.78:0/136833398 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f8860016790 con 0x7f886815a580 2024-09-10T11:48:01.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:01.967 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f884806f710 msgr2=0x7f8848071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f884806f710 0x7f8848071bd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8850001230 tx=0x7f8850009040 comp rx=0 tx=0).stop 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 msgr2=0x7f886806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 0x7f886806e760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f886001c5e0 tx=0x7f8860005b00 comp rx=0 tx=0).stop 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 shutdown_connections 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f884806f710 0x7f8848071bd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f886815a580 0x7f886806e760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88680732d0 0x7f8868157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 --2- 172.21.15.78:0/136833398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f886806ff80 0x7f886814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 >> 172.21.15.78:0/136833398 conn(0x7f88680cf7c0 msgr2=0x7f8868158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 shutdown_connections 2024-09-10T11:48:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:01.966+0000 7f886e33b640 1 -- 172.21.15.78:0/136833398 wait complete. 2024-09-10T11:48:04.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 -- 172.21.15.78:0/1250328455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3006ded0 msgr2=0x7f6f3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 --2- 172.21.15.78:0/1250328455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3006ded0 0x7f6f3006e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f300b2630 tx=0x7f6f2401f370 comp rx=0 tx=0).stop 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 -- 172.21.15.78:0/1250328455 shutdown_connections 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 --2- 172.21.15.78:0/1250328455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3006ded0 0x7f6f3006e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 --2- 172.21.15.78:0/1250328455 >> v2:172.21.15.112:3300/0 conn(0x7f6f3015f270 0x7f6f3015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 -- 172.21.15.78:0/1250328455 >> 172.21.15.78:0/1250328455 conn(0x7f6f300cf7c0 msgr2=0x7f6f300cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 -- 172.21.15.78:0/1250328455 shutdown_connections 2024-09-10T11:48:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.114+0000 7f6f37228640 1 -- 172.21.15.78:0/1250328455 wait complete. 2024-09-10T11:48:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 Processor -- start 2024-09-10T11:48:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 -- start start 2024-09-10T11:48:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f3006ded0 0x7f6f301e6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 0x7f6f301e4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3015f270 0x7f6f300a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6f300cecc0 con 0x7f6f3015bc80 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f300ceb40 con 0x7f6f3015f270 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300cee40 con 0x7f6f3006ded0 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 0x7f6f301e4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 0x7f6f301e4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57534/0 (socket says 172.21.15.78:57534) 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 -- 172.21.15.78:0/3342045417 learned_addr learned my addr 172.21.15.78:0/3342045417 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f357c5640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3015f270 0x7f6f300a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 -- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f3006ded0 msgr2=0x7f6f301e6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f3006ded0 0x7f6f301e6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 -- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3015f270 msgr2=0x7f6f300a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3015f270 0x7f6f300a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 -- 172.21.15.78:0/3342045417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f301ec570 con 0x7f6f3015bc80 2024-09-10T11:48:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f357c5640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3015f270 0x7f6f300a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2ffff640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 0x7f6f301e4ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000f90 tx=0x7f6f240af560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f240b4040 con 0x7f6f3015bc80 2024-09-10T11:48:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f240bf070 con 0x7f6f3015bc80 2024-09-10T11:48:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f240b0a30 con 0x7f6f3015bc80 2024-09-10T11:48:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f301e4ff0 con 0x7f6f3015bc80 2024-09-10T11:48:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.118+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f301e5570 con 0x7f6f3015bc80 2024-09-10T11:48:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.122+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3015c9a0 con 0x7f6f3015bc80 2024-09-10T11:48:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.122+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f6f240b0bf0 con 0x7f6f3015bc80 2024-09-10T11:48:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.122+0000 7f6f2d7fa640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6f1c06f710 0x7f6f1c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.122+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f2412dbd0 con 0x7f6f3015bc80 2024-09-10T11:48:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.122+0000 7f6f34fc4640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6f1c06f710 0x7f6f1c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:05.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.122+0000 7f6f34fc4640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6f1c06f710 0x7f6f1c071bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f301e6b80 tx=0x7f6f20005be0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:05.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.126+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f6f24018ed0 con 0x7f6f3015bc80 2024-09-10T11:48:05.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6f300cfcd0 con 0x7f6f3015bc80 2024-09-10T11:48:05.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f2d7fa640 1 -- 172.21.15.78:0/3342045417 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f6f240fab10 con 0x7f6f3015bc80 2024-09-10T11:48:05.304 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:05.304 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:05.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6f1c06f710 msgr2=0x7f6f1c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:05.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6f1c06f710 0x7f6f1c071bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f301e6b80 tx=0x7f6f20005be0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 msgr2=0x7f6f301e4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:05.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 0x7f6f301e4ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000f90 tx=0x7f6f240af560 comp rx=0 tx=0).stop 2024-09-10T11:48:05.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 shutdown_connections 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3015f270 0x7f6f300a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6f1c06f710 0x7f6f1c071bd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f3015bc80 0x7f6f301e4ab0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 --2- 172.21.15.78:0/3342045417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f3006ded0 0x7f6f301e6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 >> 172.21.15.78:0/3342045417 conn(0x7f6f300cf7c0 msgr2=0x7f6f3015cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 shutdown_connections 2024-09-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:05.302+0000 7f6f37228640 1 -- 172.21.15.78:0/3342045417 wait complete. 2024-09-10T11:48:08.322 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:08.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/3399166691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a70003a10 msgr2=0x7f3a70003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:08.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/3399166691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a70003a10 0x7f3a70003e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c2c0 tx=0x7f3a7801cf80 comp rx=0 tx=0).stop 2024-09-10T11:48:08.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8d539640 1 -- 172.21.15.78:0/3399166691 reap_dead start 2024-09-10T11:48:08.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/3399166691 shutdown_connections 2024-09-10T11:48:08.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/3399166691 >> 172.21.15.78:0/3399166691 conn(0x7f3a880cf7c0 msgr2=0x7f3a880cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:08.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/3399166691 shutdown_connections 2024-09-10T11:48:08.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.454+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/3399166691 wait complete. 2024-09-10T11:48:08.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 Processor -- start 2024-09-10T11:48:08.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- start start 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a70003a10 0x7f3a88153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a8815cac0 0x7f3a881f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 0x7f3a881597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880cef80 con 0x7f3a881f5ed0 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880cee00 con 0x7f3a70003a10 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3a880cf100 con 0x7f3a8815cac0 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 0x7f3a881597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:08.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 0x7f3a881597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57552/0 (socket says 172.21.15.78:57552) 2024-09-10T11:48:08.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 -- 172.21.15.78:0/1461182429 learned_addr learned my addr 172.21.15.78:0/1461182429 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:08.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a87fff640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a8815cac0 0x7f3a881f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:08.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8cd38640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a70003a10 0x7f3a88153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:08.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 -- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a8815cac0 msgr2=0x7f3a881f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:08.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a8815cac0 0x7f3a881f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:08.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 -- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a70003a10 msgr2=0x7f3a88153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a70003a10 0x7f3a88153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 -- 172.21.15.78:0/1461182429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8815ba20 con 0x7f3a881f5ed0 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8cd38640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a70003a10 0x7f3a88153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8d539640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 0x7f3a881597a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a8806e0d0 tx=0x7f3a8000fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000dd70 con 0x7f3a881f5ed0 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a80011440 con 0x7f3a881f5ed0 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8815bd00 con 0x7f3a881f5ed0 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80011890 con 0x7f3a881f5ed0 2024-09-10T11:48:08.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8815c2c0 con 0x7f3a881f5ed0 2024-09-10T11:48:08.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.458+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8806e100 con 0x7f3a881f5ed0 2024-09-10T11:48:08.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.462+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f3a80011a30 con 0x7f3a881f5ed0 2024-09-10T11:48:08.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.462+0000 7f3a857fa640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3a7406f740 0x7f3a74071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:08.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.462+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3a800901e0 con 0x7f3a881f5ed0 2024-09-10T11:48:08.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.462+0000 7f3a8cd38640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3a7406f740 0x7f3a74071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:08.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.462+0000 7f3a8cd38640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3a7406f740 0x7f3a74071c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a780ab000 tx=0x7f3a780a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.466+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f3a80021060 con 0x7f3a881f5ed0 2024-09-10T11:48:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3a8806aa30 con 0x7f3a881f5ed0 2024-09-10T11:48:08.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a857fa640 1 -- 172.21.15.78:0/1461182429 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f3a8005d100 con 0x7f3a881f5ed0 2024-09-10T11:48:08.648 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:08.648 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:08.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3a7406f740 msgr2=0x7f3a74071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:08.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3a7406f740 0x7f3a74071c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a780ab000 tx=0x7f3a780a7040 comp rx=0 tx=0).stop 2024-09-10T11:48:08.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 msgr2=0x7f3a881597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:08.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 0x7f3a881597a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a8806e0d0 tx=0x7f3a8000fe00 comp rx=0 tx=0).stop 2024-09-10T11:48:08.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 shutdown_connections 2024-09-10T11:48:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3a7406f740 0x7f3a74071c00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a881f5ed0 0x7f3a881597a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a8815cac0 0x7f3a881f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 --2- 172.21.15.78:0/1461182429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a70003a10 0x7f3a88153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 >> 172.21.15.78:0/1461182429 conn(0x7f3a880cf7c0 msgr2=0x7f3a88156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 shutdown_connections 2024-09-10T11:48:08.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:08.646+0000 7f3a8ef9c640 1 -- 172.21.15.78:0/1461182429 wait complete. 2024-09-10T11:48:11.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbcde3d640 1 -- 172.21.15.78:0/172138847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 msgr2=0x7ffbb0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/172138847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbb0003e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005fd0 tx=0x7ffbbc01cd60 comp rx=0 tx=0).stop 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbc7fff640 1 -- 172.21.15.78:0/172138847 reap_dead start 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbcde3d640 1 -- 172.21.15.78:0/172138847 shutdown_connections 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbcde3d640 1 -- 172.21.15.78:0/172138847 >> 172.21.15.78:0/172138847 conn(0x7ffbc80cf7c0 msgr2=0x7ffbc80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbcde3d640 1 -- 172.21.15.78:0/172138847 shutdown_connections 2024-09-10T11:48:11.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.797+0000 7ffbcde3d640 1 -- 172.21.15.78:0/172138847 wait complete. 2024-09-10T11:48:11.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 Processor -- start 2024-09-10T11:48:11.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- start start 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbc8166ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80b0980 0x7ffbc814d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc814dd20 0x7ffbc8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc81678e0 con 0x7ffbb0003a40 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8167760 con 0x7ffbc80b0980 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc8167a60 con 0x7ffbc814dd20 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbc8166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbc8166ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45242/0 (socket says 172.21.15.78:45242) 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 -- 172.21.15.78:0/3089167878 learned_addr learned my addr 172.21.15.78:0/3089167878 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 -- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc814dd20 msgr2=0x7ffbc8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc814dd20 0x7ffbc8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 -- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80b0980 msgr2=0x7ffbc814d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80b0980 0x7ffbc814d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 -- 172.21.15.78:0/3089167878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc81671e0 con 0x7ffbb0003a40 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbc77fe640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbc8166ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc01cb90 tx=0x7ffbbc0055b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0ab040 con 0x7ffbb0003a40 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbbc0be070 con 0x7ffbb0003a40 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc8155d20 con 0x7ffbb0003a40 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004930 con 0x7ffbb0003a40 2024-09-10T11:48:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc80afea0 con 0x7ffbb0003a40 2024-09-10T11:48:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.801+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc815f260 con 0x7ffbb0003a40 2024-09-10T11:48:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.805+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7ffbbc0b6070 con 0x7ffbb0003a40 2024-09-10T11:48:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.805+0000 7ffbaffff640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ffbb406f770 0x7ffbb4071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.805+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ffbbc12a340 con 0x7ffbb0003a40 2024-09-10T11:48:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.805+0000 7ffbc6ffd640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ffbb406f770 0x7ffbb4071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.805+0000 7ffbc6ffd640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ffbb406f770 0x7ffbb4071c30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8000fc0 tx=0x7ffbb8001590 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.809+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7ffbbc016a70 con 0x7ffbb0003a40 2024-09-10T11:48:11.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.989+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffbc815d000 con 0x7ffbb0003a40 2024-09-10T11:48:11.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbaffff640 1 -- 172.21.15.78:0/3089167878 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ffbbc0f7260 con 0x7ffbb0003a40 2024-09-10T11:48:11.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ffbb406f770 msgr2=0x7ffbb4071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ffbb406f770 0x7ffbb4071c30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8000fc0 tx=0x7ffbb8001590 comp rx=0 tx=0).stop 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 msgr2=0x7ffbc8166ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbc8166ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc01cb90 tx=0x7ffbbc0055b0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 shutdown_connections 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80b0980 0x7ffbc814d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ffbb406f770 0x7ffbb4071c30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc814dd20 0x7ffbc8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 --2- 172.21.15.78:0/3089167878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbb0003a40 0x7ffbc8166ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 >> 172.21.15.78:0/3089167878 conn(0x7ffbc80cf7c0 msgr2=0x7ffbc80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 shutdown_connections 2024-09-10T11:48:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:11.993+0000 7ffbcde3d640 1 -- 172.21.15.78:0/3089167878 wait complete. 2024-09-10T11:48:15.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 -- 172.21.15.78:0/1683946199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100b3f40 msgr2=0x7f421006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 --2- 172.21.15.78:0/1683946199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100b3f40 0x7f421006f870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4210071160 tx=0x7f420001c830 comp rx=0 tx=0).stop 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 -- 172.21.15.78:0/1683946199 shutdown_connections 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 --2- 172.21.15.78:0/1683946199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100b3f40 0x7f421006f870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 --2- 172.21.15.78:0/1683946199 >> v2:172.21.15.112:3300/0 conn(0x7f4210158180 0x7f42100b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 -- 172.21.15.78:0/1683946199 >> 172.21.15.78:0/1683946199 conn(0x7f42100cf7c0 msgr2=0x7f42100cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 -- 172.21.15.78:0/1683946199 shutdown_connections 2024-09-10T11:48:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.145+0000 7f4217cc7640 1 -- 172.21.15.78:0/1683946199 wait complete. 2024-09-10T11:48:15.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 Processor -- start 2024-09-10T11:48:15.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- start start 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421006fdb0 0x7f42101fa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42100b3f40 0x7f4210164c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 0x7f4210163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42101674d0 con 0x7f4210158180 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4210167350 con 0x7f421006fdb0 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4210167650 con 0x7f42100b3f40 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 0x7f4210163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 0x7f4210163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45258/0 (socket says 172.21.15.78:45258) 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 -- 172.21.15.78:0/2072878534 learned_addr learned my addr 172.21.15.78:0/2072878534 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4215a63640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421006fdb0 0x7f42101fa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4215262640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42100b3f40 0x7f4210164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 -- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42100b3f40 msgr2=0x7f4210164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42100b3f40 0x7f4210164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 -- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421006fdb0 msgr2=0x7f42101fa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421006fdb0 0x7f42101fa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 -- 172.21.15.78:0/2072878534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42101fad90 con 0x7f4210158180 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4216264640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 0x7f4210163920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f420800c7f0 tx=0x7f420800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208003b80 con 0x7f4210158180 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4208003d20 con 0x7f4210158180 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42101fb070 con 0x7f4210158180 2024-09-10T11:48:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420800aab0 con 0x7f4210158180 2024-09-10T11:48:15.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101fb630 con 0x7f4210158180 2024-09-10T11:48:15.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.149+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42100aee30 con 0x7f4210158180 2024-09-10T11:48:15.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.153+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f420800ac50 con 0x7f4210158180 2024-09-10T11:48:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.153+0000 7f42067fc640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f41f406f710 0x7f41f4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.153+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f420808f680 con 0x7f4210158180 2024-09-10T11:48:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.153+0000 7f4215a63640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f41f406f710 0x7f41f4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.153+0000 7f4215a63640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f41f406f710 0x7f41f4071bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f420c006fd0 tx=0x7f420c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.157+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f420805bfe0 con 0x7f4210158180 2024-09-10T11:48:15.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.333+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f421006f870 con 0x7f4210158180 2024-09-10T11:48:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f42067fc640 1 -- 172.21.15.78:0/2072878534 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f42080607a0 con 0x7f4210158180 2024-09-10T11:48:15.542 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:15.542 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f41f406f710 msgr2=0x7f41f4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f41f406f710 0x7f41f4071bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f420c006fd0 tx=0x7f420c008040 comp rx=0 tx=0).stop 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 msgr2=0x7f4210163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 0x7f4210163920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f420800c7f0 tx=0x7f420800ccb0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 shutdown_connections 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f41f406f710 0x7f41f4071bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4210158180 0x7f4210163920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42100b3f40 0x7f4210164c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 --2- 172.21.15.78:0/2072878534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421006fdb0 0x7f42101fa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 >> 172.21.15.78:0/2072878534 conn(0x7f42100cf7c0 msgr2=0x7f421014e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 shutdown_connections 2024-09-10T11:48:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:15.337+0000 7f4217cc7640 1 -- 172.21.15.78:0/2072878534 wait complete. 2024-09-10T11:48:18.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- 172.21.15.78:0/587743688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9524004810 msgr2=0x7f9524004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 --2- 172.21.15.78:0/587743688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9524004810 0x7f9524004c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95300016c0 tx=0x7f953001c790 comp rx=0 tx=0).stop 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953bfff640 1 -- 172.21.15.78:0/587743688 reap_dead start 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- 172.21.15.78:0/587743688 shutdown_connections 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- 172.21.15.78:0/587743688 >> 172.21.15.78:0/587743688 conn(0x7f953c0cf7c0 msgr2=0x7f953c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- 172.21.15.78:0/587743688 shutdown_connections 2024-09-10T11:48:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- 172.21.15.78:0/587743688 wait complete. 2024-09-10T11:48:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 Processor -- start 2024-09-10T11:48:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- start start 2024-09-10T11:48:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c1f1f70 0x7f953c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f953c146d00 0x7f953c1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 0x7f953c156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f953c1634e0 con 0x7f953c0ae2f0 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f953c163360 con 0x7f953c1f1f70 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f9541be8640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f953c163660 con 0x7f953c146d00 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 0x7f953c156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 0x7f953c156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45278/0 (socket says 172.21.15.78:45278) 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953bfff640 1 -- 172.21.15.78:0/301415326 learned_addr learned my addr 172.21.15.78:0/301415326 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953b7fe640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c1f1f70 0x7f953c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953affd640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f953c146d00 0x7f953c1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.681+0000 7f953bfff640 1 -- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f953c146d00 msgr2=0x7f953c1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953bfff640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f953c146d00 0x7f953c1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953bfff640 1 -- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c1f1f70 msgr2=0x7f953c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953bfff640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c1f1f70 0x7f953c0addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953bfff640 1 -- 172.21.15.78:0/301415326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c1f5e30 con 0x7f953c0ae2f0 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953affd640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f953c146d00 0x7f953c1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953bfff640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 0x7f953c156820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f953c0b25c0 tx=0x7f9534010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534004d30 con 0x7f953c0ae2f0 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f953400e8a0 con 0x7f953c0ae2f0 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953400ecf0 con 0x7f953c0ae2f0 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953c1f6110 con 0x7f953c0ae2f0 2024-09-10T11:48:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953c1f66d0 con 0x7f953c0ae2f0 2024-09-10T11:48:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953c06f870 con 0x7f953c0ae2f0 2024-09-10T11:48:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f953401a030 con 0x7f953c0ae2f0 2024-09-10T11:48:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9523fff640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f952806f710 0x7f9528071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f95340900a0 con 0x7f953c0ae2f0 2024-09-10T11:48:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.685+0000 7f953b7fe640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f952806f710 0x7f9528071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.689+0000 7f953b7fe640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f952806f710 0x7f9528071bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f952c00f8e0 tx=0x7f952c00fce0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:18.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.689+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f953405ca50 con 0x7f953c0ae2f0 2024-09-10T11:48:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.869+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f953c0ceb20 con 0x7f953c0ae2f0 2024-09-10T11:48:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9523fff640 1 -- 172.21.15.78:0/301415326 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f9534061210 con 0x7f953c0ae2f0 2024-09-10T11:48:18.875 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:18.875 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:18.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f952806f710 msgr2=0x7f9528071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:18.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f952806f710 0x7f9528071bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f952c00f8e0 tx=0x7f952c00fce0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 msgr2=0x7f953c156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:18.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 0x7f953c156820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f953c0b25c0 tx=0x7f9534010ce0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 shutdown_connections 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f952806f710 0x7f9528071bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f953c0ae2f0 0x7f953c156820 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f953c146d00 0x7f953c1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 --2- 172.21.15.78:0/301415326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c1f1f70 0x7f953c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 >> 172.21.15.78:0/301415326 conn(0x7f953c0cf7c0 msgr2=0x7f953c0cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 shutdown_connections 2024-09-10T11:48:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:18.873+0000 7f9541be8640 1 -- 172.21.15.78:0/301415326 wait complete. 2024-09-10T11:48:19.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:48:19.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:48:21.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f291c640 1 -- 172.21.15.78:0/1369972971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31d8003a10 msgr2=0x7f31d8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f291c640 1 --2- 172.21.15.78:0/1369972971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31d8003a10 0x7f31d8003e30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009e00 tx=0x7f31d401d140 comp rx=0 tx=0).stop 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f0eb9640 1 -- 172.21.15.78:0/1369972971 reap_dead start 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f291c640 1 -- 172.21.15.78:0/1369972971 shutdown_connections 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f291c640 1 -- 172.21.15.78:0/1369972971 >> 172.21.15.78:0/1369972971 conn(0x7f31ec0d3c80 msgr2=0x7f31ec0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f291c640 1 -- 172.21.15.78:0/1369972971 shutdown_connections 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.025+0000 7f31f291c640 1 -- 172.21.15.78:0/1369972971 wait complete. 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 Processor -- start 2024-09-10T11:48:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 -- start start 2024-09-10T11:48:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d8003a10 0x7f31ec1fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 0x7f31ec0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ec06dc90 0x7f31ec0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0b43a0 con 0x7f31ec06d830 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0b4220 con 0x7f31d8003a10 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec0b4520 con 0x7f31ec06dc90 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 0x7f31ec0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 0x7f31ec0b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39016/0 (socket says 172.21.15.78:39016) 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 -- 172.21.15.78:0/3424997382 learned_addr learned my addr 172.21.15.78:0/3424997382 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f0eb9640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ec06dc90 0x7f31ec0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31ebfff640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d8003a10 0x7f31ec1fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 -- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ec06dc90 msgr2=0x7f31ec0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ec06dc90 0x7f31ec0b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 -- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d8003a10 msgr2=0x7f31ec1fba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d8003a10 0x7f31ec1fba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 -- 172.21.15.78:0/3424997382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec1f80e0 con 0x7f31ec06d830 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f0eb9640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ec06dc90 0x7f31ec0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31ebfff640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d8003a10 0x7f31ec1fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31eb7fe640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 0x7f31ec0b6ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31e400d820 tx=0x7f31e400dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4018070 con 0x7f31ec06d830 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31e40052e0 con 0x7f31ec06d830 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e400b920 con 0x7f31ec06d830 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec1f83c0 con 0x7f31ec06d830 2024-09-10T11:48:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.029+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec0b8270 con 0x7f31ec06d830 2024-09-10T11:48:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.033+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec0d4770 con 0x7f31ec06d830 2024-09-10T11:48:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.033+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f31e400bac0 con 0x7f31ec06d830 2024-09-10T11:48:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.033+0000 7f31e8ff9640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f31cc06f740 0x7f31cc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.033+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f31e408f110 con 0x7f31ec06d830 2024-09-10T11:48:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.033+0000 7f31ebfff640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f31cc06f740 0x7f31cc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:22.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.033+0000 7f31ebfff640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f31cc06f740 0x7f31cc071c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f31d40ae000 tx=0x7f31d4019ee0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.037+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f31e405bf00 con 0x7f31ec06d830 2024-09-10T11:48:22.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.213+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31ec0b8440 con 0x7f31ec06d830 2024-09-10T11:48:22.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.213+0000 7f31e8ff9640 1 -- 172.21.15.78:0/3424997382 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f31e405b800 con 0x7f31ec06d830 2024-09-10T11:48:22.218 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:22.218 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f31cc06f740 msgr2=0x7f31cc071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f31cc06f740 0x7f31cc071c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f31d40ae000 tx=0x7f31d4019ee0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 msgr2=0x7f31ec0b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 0x7f31ec0b6ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31e400d820 tx=0x7f31e400dce0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 shutdown_connections 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f31cc06f740 0x7f31cc071c00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ec06dc90 0x7f31ec0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31ec06d830 0x7f31ec0b6ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 --2- 172.21.15.78:0/3424997382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d8003a10 0x7f31ec1fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 >> 172.21.15.78:0/3424997382 conn(0x7f31ec0d3c80 msgr2=0x7f31ec0d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 shutdown_connections 2024-09-10T11:48:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:22.217+0000 7f31f291c640 1 -- 172.21.15.78:0/3424997382 wait complete. 2024-09-10T11:48:25.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 -- 172.21.15.78:0/390154189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 msgr2=0x7fc12c0d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 --2- 172.21.15.78:0/390154189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0d4770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc128009840 tx=0x7fc12801c7f0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 -- 172.21.15.78:0/390154189 shutdown_connections 2024-09-10T11:48:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 --2- 172.21.15.78:0/390154189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0d4770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 -- 172.21.15.78:0/390154189 >> 172.21.15.78:0/390154189 conn(0x7fc12c0d3c80 msgr2=0x7fc12c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 -- 172.21.15.78:0/390154189 shutdown_connections 2024-09-10T11:48:25.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 -- 172.21.15.78:0/390154189 wait complete. 2024-09-10T11:48:25.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 Processor -- start 2024-09-10T11:48:25.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.369+0000 7fc133e1c640 1 -- start start 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc12c0b4a10 0x7fc12c0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc12c161630 0x7fc12c0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c16bee0 con 0x7fc12c161250 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c16bd60 con 0x7fc12c161630 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c16c060 con 0x7fc12c0b4a10 2024-09-10T11:48:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0b75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39020/0 (socket says 172.21.15.78:39020) 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 -- 172.21.15.78:0/2472730697 learned_addr learned my addr 172.21.15.78:0/2472730697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1323b9640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc12c161630 0x7fc12c0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc131bb8640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc12c0b4a10 0x7fc12c0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 -- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc12c0b4a10 msgr2=0x7fc12c0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc12c0b4a10 0x7fc12c0b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 -- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc12c161630 msgr2=0x7fc12c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc12c161630 0x7fc12c0cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 -- 172.21.15.78:0/2472730697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c15a580 con 0x7fc12c161250 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1323b9640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc12c161630 0x7fc12c0cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1313b7640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0b75d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c460 tx=0x7fc11c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c016020 con 0x7fc12c161250 2024-09-10T11:48:25.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc11c012940 con 0x7fc12c161250 2024-09-10T11:48:25.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c15a860 con 0x7fc12c161250 2024-09-10T11:48:25.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012d90 con 0x7fc12c161250 2024-09-10T11:48:25.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c0b7b10 con 0x7fc12c161250 2024-09-10T11:48:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12c0d4770 con 0x7fc12c161250 2024-09-10T11:48:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fc11c019020 con 0x7fc12c161250 2024-09-10T11:48:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1227fc640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc11006f710 0x7fc110071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc11c08f710 con 0x7fc12c161250 2024-09-10T11:48:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.373+0000 7fc131bb8640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc11006f710 0x7fc110071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.377+0000 7fc131bb8640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc11006f710 0x7fc110071bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1280af000 tx=0x7fc12801b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:25.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.377+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fc11c020020 con 0x7fc12c161250 2024-09-10T11:48:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc12c15afd0 con 0x7fc12c161250 2024-09-10T11:48:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc1227fc640 1 -- 172.21.15.78:0/2472730697 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc11c05c780 con 0x7fc12c161250 2024-09-10T11:48:25.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:25.556 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc11006f710 msgr2=0x7fc110071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc11006f710 0x7fc110071bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1280af000 tx=0x7fc12801b030 comp rx=0 tx=0).stop 2024-09-10T11:48:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 msgr2=0x7fc12c0b75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0b75d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c460 tx=0x7fc11c00c920 comp rx=0 tx=0).stop 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 shutdown_connections 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc12c161630 0x7fc12c0cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc11006f710 0x7fc110071bd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc12c161250 0x7fc12c0b75d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 --2- 172.21.15.78:0/2472730697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc12c0b4a10 0x7fc12c0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 >> 172.21.15.78:0/2472730697 conn(0x7fc12c0d3c80 msgr2=0x7fc12c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 shutdown_connections 2024-09-10T11:48:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:25.553+0000 7fc133e1c640 1 -- 172.21.15.78:0/2472730697 wait complete. 2024-09-10T11:48:28.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/3621442919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb0003a60 msgr2=0x7f1fb0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/3621442919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb0003a60 0x7f1fb0003e80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009b60 tx=0x7f1fb401d240 comp rx=0 tx=0).stop 2024-09-10T11:48:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/3621442919 shutdown_connections 2024-09-10T11:48:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/3621442919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb0003a60 0x7f1fb0003e80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/3621442919 >> 172.21.15.78:0/3621442919 conn(0x7f1fc40d3c80 msgr2=0x7f1fc40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/3621442919 shutdown_connections 2024-09-10T11:48:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/3621442919 wait complete. 2024-09-10T11:48:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 Processor -- start 2024-09-10T11:48:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.705+0000 7f1fcb8cc640 1 -- start start 2024-09-10T11:48:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb0003a60 0x7f1fc414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 0x7f1fc40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fc40c7b20 0x7f1fc40cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40d1dd0 con 0x7f1fc4157480 2024-09-10T11:48:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40d1c50 con 0x7f1fb0003a60 2024-09-10T11:48:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40d1f50 con 0x7f1fc40c7b20 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 0x7f1fc40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 0x7f1fc40c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39036/0 (socket says 172.21.15.78:39036) 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 -- 172.21.15.78:0/2861907152 learned_addr learned my addr 172.21.15.78:0/2861907152 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc9e69640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fc40c7b20 0x7f1fc40cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc9668640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb0003a60 0x7f1fc414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 -- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fc40c7b20 msgr2=0x7f1fc40cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fc40c7b20 0x7f1fc40cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 -- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb0003a60 msgr2=0x7f1fc414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb0003a60 0x7f1fc414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 -- 172.21.15.78:0/2861907152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40cc480 con 0x7f1fc4157480 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc9668640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb0003a60 0x7f1fc414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc8e67640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 0x7f1fc40c75e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000d7e0 tx=0x7f1fc000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0019070 con 0x7f1fc4157480 2024-09-10T11:48:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fc00050d0 con 0x7f1fc4157480 2024-09-10T11:48:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc40cc760 con 0x7f1fc4157480 2024-09-10T11:48:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000b660 con 0x7f1fc4157480 2024-09-10T11:48:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc40ccd20 con 0x7f1fc4157480 2024-09-10T11:48:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc40d24b0 con 0x7f1fc4157480 2024-09-10T11:48:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1fc001c070 con 0x7f1fc4157480 2024-09-10T11:48:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fb9ffb640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fa806f710 0x7f1fa8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1fc008ef80 con 0x7f1fc4157480 2024-09-10T11:48:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.709+0000 7f1fc9668640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fa806f710 0x7f1fa8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.713+0000 7f1fc9668640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fa806f710 0x7f1fa8071bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40ae000 tx=0x7f1fb4019fe0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.713+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1fc005bea0 con 0x7f1fc4157480 2024-09-10T11:48:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.897+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1fc414f4d0 con 0x7f1fc4157480 2024-09-10T11:48:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.897+0000 7f1fb9ffb640 1 -- 172.21.15.78:0/2861907152 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1fc005b7a0 con 0x7f1fc4157480 2024-09-10T11:48:28.901 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:28.901 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:28.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fa806f710 msgr2=0x7f1fa8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fa806f710 0x7f1fa8071bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40ae000 tx=0x7f1fb4019fe0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 msgr2=0x7f1fc40c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 0x7f1fc40c75e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000d7e0 tx=0x7f1fc000dca0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 shutdown_connections 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1fa806f710 0x7f1fa8071bd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fc40c7b20 0x7f1fc40cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc4157480 0x7f1fc40c75e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 --2- 172.21.15.78:0/2861907152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb0003a60 0x7f1fc414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 >> 172.21.15.78:0/2861907152 conn(0x7f1fc40d3c80 msgr2=0x7f1fc40b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 shutdown_connections 2024-09-10T11:48:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:28.901+0000 7f1fcb8cc640 1 -- 172.21.15.78:0/2861907152 wait complete. 2024-09-10T11:48:31.921 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- 172.21.15.78:0/174239827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 msgr2=0x7f2200070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 --2- 172.21.15.78:0/174239827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f2200070da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009840 tx=0x7f21f801c7e0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- 172.21.15.78:0/174239827 shutdown_connections 2024-09-10T11:48:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 --2- 172.21.15.78:0/174239827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f2200070da0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 --2- 172.21.15.78:0/174239827 >> v2:172.21.15.112:3300/0 conn(0x7f22000cf140 0x7f22000cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- 172.21.15.78:0/174239827 >> 172.21.15.78:0/174239827 conn(0x7f22000d19f0 msgr2=0x7f22000d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:32.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- 172.21.15.78:0/174239827 shutdown_connections 2024-09-10T11:48:32.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- 172.21.15.78:0/174239827 wait complete. 2024-09-10T11:48:32.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 Processor -- start 2024-09-10T11:48:32.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- start start 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f220014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22000cf140 0x7f22000b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f220014b0f0 0x7f22000b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2200168bc0 con 0x7f22000708f0 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2200168a40 con 0x7f220014b0f0 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f22050de640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2200168d40 con 0x7f22000cf140 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f220014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f220014a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33560/0 (socket says 172.21.15.78:33560) 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 -- 172.21.15.78:0/3954623865 learned_addr learned my addr 172.21.15.78:0/3954623865 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21ff59e640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f220014b0f0 0x7f22000b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 -- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22000cf140 msgr2=0x7f22000b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fe59c640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22000cf140 0x7f22000b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22000cf140 0x7f22000b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 -- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f220014b0f0 msgr2=0x7f22000b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f220014b0f0 0x7f22000b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21fed9d640 1 -- 172.21.15.78:0/3954623865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000b3750 con 0x7f22000708f0 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.053+0000 7f21ff59e640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f220014b0f0 0x7f22000b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21fed9d640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f220014a550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21f000cbf0 tx=0x7f21f000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0016020 con 0x7f22000708f0 2024-09-10T11:48:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f000ab40 con 0x7f22000708f0 2024-09-10T11:48:32.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0012420 con 0x7f22000708f0 2024-09-10T11:48:32.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220014b860 con 0x7f22000708f0 2024-09-10T11:48:32.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22000b39f0 con 0x7f22000708f0 2024-09-10T11:48:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2200070da0 con 0x7f22000708f0 2024-09-10T11:48:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f21f0019020 con 0x7f22000708f0 2024-09-10T11:48:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21e77fe640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f21ec06f710 0x7f21ec071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f21f008f570 con 0x7f22000708f0 2024-09-10T11:48:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.057+0000 7f21fe59c640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f21ec06f710 0x7f21ec071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.061+0000 7f21fe59c640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f21ec06f710 0x7f21ec071bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22000b79d0 tx=0x7f21f4008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.061+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f21f0020070 con 0x7f22000708f0 2024-09-10T11:48:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.245+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f22000c4ee0 con 0x7f22000708f0 2024-09-10T11:48:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.245+0000 7f21e77fe640 1 -- 172.21.15.78:0/3954623865 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f21f005c490 con 0x7f22000708f0 2024-09-10T11:48:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:32.252 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f21ec06f710 msgr2=0x7f21ec071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f21ec06f710 0x7f21ec071bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22000b79d0 tx=0x7f21f4008040 comp rx=0 tx=0).stop 2024-09-10T11:48:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 msgr2=0x7f220014a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f220014a550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21f000cbf0 tx=0x7f21f000cc20 comp rx=0 tx=0).stop 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 shutdown_connections 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f220014b0f0 0x7f22000b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f21ec06f710 0x7f21ec071bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22000cf140 0x7f22000b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 --2- 172.21.15.78:0/3954623865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000708f0 0x7f220014a550 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 >> 172.21.15.78:0/3954623865 conn(0x7f22000d19f0 msgr2=0x7f22000c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 shutdown_connections 2024-09-10T11:48:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:32.249+0000 7f22050de640 1 -- 172.21.15.78:0/3954623865 wait complete. 2024-09-10T11:48:35.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/422887706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 msgr2=0x7f699815c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 --2- 172.21.15.78:0/422887706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 0x7f699815c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6990009c80 tx=0x7f699001cd70 comp rx=0 tx=0).stop 2024-09-10T11:48:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/422887706 shutdown_connections 2024-09-10T11:48:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 --2- 172.21.15.78:0/422887706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 0x7f699815c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 --2- 172.21.15.78:0/422887706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69980732d0 0x7f699806f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/422887706 >> 172.21.15.78:0/422887706 conn(0x7f69980cf7c0 msgr2=0x7f69980cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/422887706 shutdown_connections 2024-09-10T11:48:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/422887706 wait complete. 2024-09-10T11:48:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 Processor -- start 2024-09-10T11:48:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- start start 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 0x7f6998154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 0x7f699815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f699815a580 0x7f69980af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6998167500 con 0x7f69980732d0 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6998167380 con 0x7f699806fdb0 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6998167680 con 0x7f699815a580 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 0x7f699815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 0x7f699815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33572/0 (socket says 172.21.15.78:33572) 2024-09-10T11:48:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 -- 172.21.15.78:0/1644916589 learned_addr learned my addr 172.21.15.78:0/1644916589 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f6997fff640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 0x7f6998154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699caa0640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f699815a580 0x7f69980af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 -- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f699815a580 msgr2=0x7f69980af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f699815a580 0x7f69980af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 -- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 msgr2=0x7f6998154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 0x7f6998154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 -- 172.21.15.78:0/1644916589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69980b0030 con 0x7f69980732d0 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f69977fe640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 0x7f699815da00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f698c00e9c0 tx=0x7f698c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c00cd80 con 0x7f69980732d0 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f698c005020 con 0x7f69980732d0 2024-09-10T11:48:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69980b0310 con 0x7f69980732d0 2024-09-10T11:48:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c005470 con 0x7f69980732d0 2024-09-10T11:48:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.405+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69980b1540 con 0x7f69980732d0 2024-09-10T11:48:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.409+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69980b1070 con 0x7f69980732d0 2024-09-10T11:48:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.409+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f698c0047b0 con 0x7f69980732d0 2024-09-10T11:48:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.409+0000 7f6994ff9640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f698406f710 0x7f6984071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.409+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f698c0903d0 con 0x7f69980732d0 2024-09-10T11:48:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.409+0000 7f6997fff640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f698406f710 0x7f6984071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.409+0000 7f6997fff640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f698406f710 0x7f6984071bd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6988001650 tx=0x7f6988009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:35.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.413+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f698c05d270 con 0x7f69980732d0 2024-09-10T11:48:35.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.589+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f69980b29a0 con 0x7f69980732d0 2024-09-10T11:48:35.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f6994ff9640 1 -- 172.21.15.78:0/1644916589 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f698c05cb70 con 0x7f69980732d0 2024-09-10T11:48:35.595 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:35.595 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f698406f710 msgr2=0x7f6984071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f698406f710 0x7f6984071bd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6988001650 tx=0x7f6988009040 comp rx=0 tx=0).stop 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 msgr2=0x7f699815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 0x7f699815da00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f698c00e9c0 tx=0x7f698c00ee80 comp rx=0 tx=0).stop 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 shutdown_connections 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f698406f710 0x7f6984071bd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f699815a580 0x7f69980af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69980732d0 0x7f699815da00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 --2- 172.21.15.78:0/1644916589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699806fdb0 0x7f6998154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 >> 172.21.15.78:0/1644916589 conn(0x7f69980cf7c0 msgr2=0x7f6998156570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 shutdown_connections 2024-09-10T11:48:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:35.593+0000 7f699e503640 1 -- 172.21.15.78:0/1644916589 wait complete. 2024-09-10T11:48:38.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- 172.21.15.78:0/3113262675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 msgr2=0x7f03f815f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 --2- 172.21.15.78:0/3113262675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f815f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f03f80ae660 tx=0x7f03f001cb50 comp rx=0 tx=0).stop 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- 172.21.15.78:0/3113262675 shutdown_connections 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 --2- 172.21.15.78:0/3113262675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f815f4c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 --2- 172.21.15.78:0/3113262675 >> v2:172.21.15.112:3300/0 conn(0x7f03f80ad8d0 0x7f03f80adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- 172.21.15.78:0/3113262675 >> 172.21.15.78:0/3113262675 conn(0x7f03f80cf7c0 msgr2=0x7f03f80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- 172.21.15.78:0/3113262675 shutdown_connections 2024-09-10T11:48:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- 172.21.15.78:0/3113262675 wait complete. 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 Processor -- start 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- start start 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f80ad8d0 0x7f03f815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f8160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f8148720 0x7f03f8158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03f816ab30 con 0x7f03f815f070 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03f816a9b0 con 0x7f03f8148720 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03ff88d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03f816acb0 con 0x7f03f80ad8d0 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f8160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f8160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33586/0 (socket says 172.21.15.78:33586) 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 -- 172.21.15.78:0/2860252300 learned_addr learned my addr 172.21.15.78:0/2860252300 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 -- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f80ad8d0 msgr2=0x7f03f815fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fde2a640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f8148720 0x7f03f8158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fd629640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f80ad8d0 0x7f03f815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f80ad8d0 0x7f03f815fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 -- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f8148720 msgr2=0x7f03f8158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f8148720 0x7f03f8158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 -- 172.21.15.78:0/2860252300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f81fab90 con 0x7f03f815f070 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fde2a640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f8148720 0x7f03f8158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03fce28640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f8160040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c500 tx=0x7f03ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec017070 con 0x7f03f815f070 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.745+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03ec003600 con 0x7f03f815f070 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec003a90 con 0x7f03f815f070 2024-09-10T11:48:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f81fae70 con 0x7f03f815f070 2024-09-10T11:48:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f81fb430 con 0x7f03f815f070 2024-09-10T11:48:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f81fb810 con 0x7f03f815f070 2024-09-10T11:48:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f03ec01a070 con 0x7f03f815f070 2024-09-10T11:48:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03e9ffb640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03dc06f760 0x7f03dc071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:38.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f03ec08ebd0 con 0x7f03f815f070 2024-09-10T11:48:38.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03fd629640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03dc06f760 0x7f03dc071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:38.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.749+0000 7f03fd629640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03dc06f760 0x7f03dc071c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03f400a830 tx=0x7f03f4008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:38.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.753+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f03f81fb810 con 0x7f03f815f070 2024-09-10T11:48:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.937+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f03f815f4c0 con 0x7f03f815f070 2024-09-10T11:48:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.937+0000 7f03e9ffb640 1 -- 172.21.15.78:0/2860252300 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f03ec05bd20 con 0x7f03f815f070 2024-09-10T11:48:38.942 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:38.942 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03dc06f760 msgr2=0x7f03dc071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03dc06f760 0x7f03dc071c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03f400a830 tx=0x7f03f4008040 comp rx=0 tx=0).stop 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 msgr2=0x7f03f8160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f8160040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c500 tx=0x7f03ec00c9c0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 shutdown_connections 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f8148720 0x7f03f8158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03dc06f760 0x7f03dc071c20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03f815f070 0x7f03f8160040 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 --2- 172.21.15.78:0/2860252300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f80ad8d0 0x7f03f815fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 >> 172.21.15.78:0/2860252300 conn(0x7f03f80cf7c0 msgr2=0x7f03f815cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 shutdown_connections 2024-09-10T11:48:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:38.941+0000 7f03ff88d640 1 -- 172.21.15.78:0/2860252300 wait complete. 2024-09-10T11:48:41.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 -- 172.21.15.78:0/2410769184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c06e790 msgr2=0x7f095c0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 --2- 172.21.15.78:0/2410769184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c06e790 0x7f095c0cdf10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0954009c80 tx=0x7f095401cd00 comp rx=0 tx=0).stop 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 -- 172.21.15.78:0/2410769184 shutdown_connections 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 --2- 172.21.15.78:0/2410769184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c06e790 0x7f095c0cdf10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 --2- 172.21.15.78:0/2410769184 >> v2:172.21.15.112:3300/0 conn(0x7f095c0b5680 0x7f095c06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 -- 172.21.15.78:0/2410769184 >> 172.21.15.78:0/2410769184 conn(0x7f095c0cf7c0 msgr2=0x7f095c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 -- 172.21.15.78:0/2410769184 shutdown_connections 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.093+0000 7f0963def640 1 -- 172.21.15.78:0/2410769184 wait complete. 2024-09-10T11:48:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 Processor -- start 2024-09-10T11:48:42.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- start start 2024-09-10T11:48:42.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f095c06e790 0x7f095c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:42.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f095c0b5680 0x7f095c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 0x7f095c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f095c168870 con 0x7f095c152830 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f095c1686f0 con 0x7f095c0b5680 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f095c1689f0 con 0x7f095c06e790 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 0x7f095c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 0x7f095c0b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57606/0 (socket says 172.21.15.78:57606) 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 -- 172.21.15.78:0/3131297707 learned_addr learned my addr 172.21.15.78:0/3131297707 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0961b8b640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f095c06e790 0x7f095c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096138a640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f095c0b5680 0x7f095c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 -- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f095c06e790 msgr2=0x7f095c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f095c06e790 0x7f095c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 -- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f095c0b5680 msgr2=0x7f095c1556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f095c0b5680 0x7f095c1556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 -- 172.21.15.78:0/3131297707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c0b41c0 con 0x7f095c152830 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f096238c640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 0x7f095c0b1e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f095401d5a0 tx=0x7f0954009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540bb070 con 0x7f095c152830 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0954004e00 con 0x7f095c152830 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c0b2be0 con 0x7f095c152830 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540b2040 con 0x7f095c152830 2024-09-10T11:48:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c0b31a0 con 0x7f095c152830 2024-09-10T11:48:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.097+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095c155c30 con 0x7f095c152830 2024-09-10T11:48:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.101+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f09540be070 con 0x7f095c152830 2024-09-10T11:48:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.101+0000 7f09527fc640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f094006f710 0x7f0940071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.101+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0954129620 con 0x7f095c152830 2024-09-10T11:48:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.101+0000 7f0961b8b640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f094006f710 0x7f0940071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.101+0000 7f0961b8b640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f094006f710 0x7f0940071bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09580098e0 tx=0x7f0958009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:42.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.101+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0954016950 con 0x7f095c152830 2024-09-10T11:48:42.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.277+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f095c15f580 con 0x7f095c152830 2024-09-10T11:48:42.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f09527fc640 1 -- 172.21.15.78:0/3131297707 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f09540f6060 con 0x7f095c152830 2024-09-10T11:48:42.284 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:42.284 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:42.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f094006f710 msgr2=0x7f0940071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:42.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f094006f710 0x7f0940071bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09580098e0 tx=0x7f0958009060 comp rx=0 tx=0).stop 2024-09-10T11:48:42.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 msgr2=0x7f095c0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 0x7f095c0b1e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f095401d5a0 tx=0x7f0954009390 comp rx=0 tx=0).stop 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 shutdown_connections 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f095c0b5680 0x7f095c1556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f094006f710 0x7f0940071bd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f095c152830 0x7f095c0b1e20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 --2- 172.21.15.78:0/3131297707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f095c06e790 0x7f095c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 >> 172.21.15.78:0/3131297707 conn(0x7f095c0cf7c0 msgr2=0x7f095c073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 shutdown_connections 2024-09-10T11:48:42.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:42.281+0000 7f0963def640 1 -- 172.21.15.78:0/3131297707 wait complete. 2024-09-10T11:48:45.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 -- 172.21.15.78:0/4281540149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7480b4a10 msgr2=0x7ff7480d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 --2- 172.21.15.78:0/4281540149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7480b4a10 0x7ff7480d0a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff7480696a0 tx=0x7ff74001cd50 comp rx=0 tx=0).stop 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 -- 172.21.15.78:0/4281540149 shutdown_connections 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 --2- 172.21.15.78:0/4281540149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7480b4a10 0x7ff7480d0a80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 --2- 172.21.15.78:0/4281540149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff748161630 0x7ff7480d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 --2- 172.21.15.78:0/4281540149 >> v2:172.21.15.112:3300/0 conn(0x7ff748161250 0x7ff7480d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 -- 172.21.15.78:0/4281540149 >> 172.21.15.78:0/4281540149 conn(0x7ff7480d3c80 msgr2=0x7ff7480d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 -- 172.21.15.78:0/4281540149 shutdown_connections 2024-09-10T11:48:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.429+0000 7ff74f25e640 1 -- 172.21.15.78:0/4281540149 wait complete. 2024-09-10T11:48:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 Processor -- start 2024-09-10T11:48:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- start start 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7480b4a10 0x7ff7480ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff748161250 0x7ff74815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 0x7ff748158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480b3520 con 0x7ff748161630 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480b33a0 con 0x7ff7480b4a10 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff7480b36a0 con 0x7ff748161250 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 0x7ff748158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 0x7ff748158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57626/0 (socket says 172.21.15.78:57626) 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 -- 172.21.15.78:0/3241196225 learned_addr learned my addr 172.21.15.78:0/3241196225 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff747fff640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff748161250 0x7ff74815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:45.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 -- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff748161250 msgr2=0x7ff74815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff748161250 0x7ff74815ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 -- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7480b4a10 msgr2=0x7ff7480ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7480b4a10 0x7ff7480ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 -- 172.21.15.78:0/3241196225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480caab0 con 0x7ff748161630 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74d7fb640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 0x7ff748158630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff74001b400 tx=0x7ff7400a5be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400bb070 con 0x7ff748161630 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff740004d40 con 0x7ff748161630 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7480b89b0 con 0x7ff748161630 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400b2040 con 0x7ff748161630 2024-09-10T11:48:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7480b8f30 con 0x7ff748161630 2024-09-10T11:48:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.433+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7480d4770 con 0x7ff748161630 2024-09-10T11:48:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.437+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7ff7400be070 con 0x7ff748161630 2024-09-10T11:48:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.437+0000 7ff7457fa640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff73406f710 0x7ff734071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.437+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff7401298e0 con 0x7ff748161630 2024-09-10T11:48:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.437+0000 7ff74cffa640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff73406f710 0x7ff734071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:45.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.437+0000 7ff74cffa640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff73406f710 0x7ff734071bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff73800a870 tx=0x7ff738005b70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:45.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.441+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7ff740016970 con 0x7ff748161630 2024-09-10T11:48:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff7480d0710 con 0x7ff748161630 2024-09-10T11:48:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff7457fa640 1 -- 172.21.15.78:0/3241196225 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ff7400f6890 con 0x7ff748161630 2024-09-10T11:48:45.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:45.621 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff73406f710 msgr2=0x7ff734071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff73406f710 0x7ff734071bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff73800a870 tx=0x7ff738005b70 comp rx=0 tx=0).stop 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 msgr2=0x7ff748158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 0x7ff748158630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff74001b400 tx=0x7ff7400a5be0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 shutdown_connections 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff73406f710 0x7ff734071bd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff748161630 0x7ff748158630 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff748161250 0x7ff74815ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 --2- 172.21.15.78:0/3241196225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7480b4a10 0x7ff7480ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 >> 172.21.15.78:0/3241196225 conn(0x7ff7480d3c80 msgr2=0x7ff7481604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 shutdown_connections 2024-09-10T11:48:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:45.617+0000 7ff74f25e640 1 -- 172.21.15.78:0/3241196225 wait complete. 2024-09-10T11:48:48.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 -- 172.21.15.78:0/3617396065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0732d0 msgr2=0x7fd64c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 --2- 172.21.15.78:0/3617396065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0732d0 0x7fd64c06f870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd640009840 tx=0x7fd64001c7f0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 -- 172.21.15.78:0/3617396065 shutdown_connections 2024-09-10T11:48:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 --2- 172.21.15.78:0/3617396065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd64c06fdb0 0x7fd64c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 --2- 172.21.15.78:0/3617396065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0732d0 0x7fd64c06f870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 -- 172.21.15.78:0/3617396065 >> 172.21.15.78:0/3617396065 conn(0x7fd64c0cf7c0 msgr2=0x7fd64c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:48.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 -- 172.21.15.78:0/3617396065 shutdown_connections 2024-09-10T11:48:48.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.769+0000 7fd6526b6640 1 -- 172.21.15.78:0/3617396065 wait complete. 2024-09-10T11:48:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 Processor -- start 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- start start 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 0x7fd64c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd64c0732d0 0x7fd64c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd64c15a580 0x7fd64c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c167380 con 0x7fd64c06fdb0 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c167500 con 0x7fd64c0732d0 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c167680 con 0x7fd64c15a580 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 0x7fd64c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 0x7fd64c14bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57640/0 (socket says 172.21.15.78:57640) 2024-09-10T11:48:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 -- 172.21.15.78:0/4009975874 learned_addr learned my addr 172.21.15.78:0/4009975874 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64b7fe640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd64c0732d0 0x7fd64c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 -- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd64c15a580 msgr2=0x7fd64c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd64c15a580 0x7fd64c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 -- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd64c0732d0 msgr2=0x7fd64c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd64c0732d0 0x7fd64c159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 -- 172.21.15.78:0/4009975874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c1f73c0 con 0x7fd64c06fdb0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd64bfff640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 0x7fd64c14bc00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c3f0 tx=0x7fd63c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c017070 con 0x7fd64c06fdb0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd63c003600 con 0x7fd64c06fdb0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c003a50 con 0x7fd64c06fdb0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c1f76a0 con 0x7fd64c06fdb0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c1f7c60 con 0x7fd64c06fdb0 2024-09-10T11:48:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c15c5a0 con 0x7fd64c06fdb0 2024-09-10T11:48:48.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.773+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd63c01a070 con 0x7fd64c06fdb0 2024-09-10T11:48:48.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.777+0000 7fd648ff9640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd63806f710 0x7fd638071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:48.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.777+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd63c08ee80 con 0x7fd64c06fdb0 2024-09-10T11:48:48.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.777+0000 7fd64b7fe640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd63806f710 0x7fd638071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:48.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.777+0000 7fd64b7fe640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd63806f710 0x7fd638071bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd6400af000 tx=0x7fd64001b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.777+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd63c021020 con 0x7fd64c06fdb0 2024-09-10T11:48:48.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.961+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd64c152fe0 con 0x7fd64c06fdb0 2024-09-10T11:48:48.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.961+0000 7fd648ff9640 1 -- 172.21.15.78:0/4009975874 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd63c05be80 con 0x7fd64c06fdb0 2024-09-10T11:48:48.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:48.965 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd63806f710 msgr2=0x7fd638071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd63806f710 0x7fd638071bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd6400af000 tx=0x7fd64001b030 comp rx=0 tx=0).stop 2024-09-10T11:48:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 msgr2=0x7fd64c14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 0x7fd64c14bc00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c3f0 tx=0x7fd63c00c8b0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 shutdown_connections 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd64c0732d0 0x7fd64c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd63806f710 0x7fd638071bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd64c15a580 0x7fd64c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 --2- 172.21.15.78:0/4009975874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c06fdb0 0x7fd64c14bc00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 >> 172.21.15.78:0/4009975874 conn(0x7fd64c0cf7c0 msgr2=0x7fd64c0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 shutdown_connections 2024-09-10T11:48:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:48.965+0000 7fd6526b6640 1 -- 172.21.15.78:0/4009975874 wait complete. 2024-09-10T11:48:49.745 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:48:49.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:48:51.985 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:52.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f46805bb640 1 -- 172.21.15.78:0/3625770891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640051d0 msgr2=0x7f466400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:52.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f46805bb640 1 --2- 172.21.15.78:0/3625770891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640051d0 0x7f466400b9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f467806ecd0 tx=0x7f467001ccd0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f467eb58640 1 -- 172.21.15.78:0/3625770891 reap_dead start 2024-09-10T11:48:52.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f46805bb640 1 -- 172.21.15.78:0/3625770891 shutdown_connections 2024-09-10T11:48:52.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f46805bb640 1 -- 172.21.15.78:0/3625770891 >> 172.21.15.78:0/3625770891 conn(0x7f46780cf7c0 msgr2=0x7f46780cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:52.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f46805bb640 1 -- 172.21.15.78:0/3625770891 shutdown_connections 2024-09-10T11:48:52.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.113+0000 7f46805bb640 1 -- 172.21.15.78:0/3625770891 wait complete. 2024-09-10T11:48:52.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 Processor -- start 2024-09-10T11:48:52.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- start start 2024-09-10T11:48:52.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46640051d0 0x7f4678148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f467814aaa0 0x7f467814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 0x7f46781f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46780ce2f0 con 0x7f46781f2490 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f46780ce170 con 0x7f467814aaa0 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f46780ce470 con 0x7f46640051d0 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 0x7f46781f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 0x7f46781f2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48976/0 (socket says 172.21.15.78:48976) 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 -- 172.21.15.78:0/450418691 learned_addr learned my addr 172.21.15.78:0/450418691 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467e357640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46640051d0 0x7f4678148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467db56640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f467814aaa0 0x7f467814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 -- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46640051d0 msgr2=0x7f4678148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46640051d0 0x7f4678148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 -- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f467814aaa0 msgr2=0x7f467814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f467814aaa0 0x7f467814af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 -- 172.21.15.78:0/450418691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46781f2e80 con 0x7f46781f2490 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f467eb58640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 0x7f46781f2940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f467001c740 tx=0x7f467000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46700bc020 con 0x7f46781f2490 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4670003c70 con 0x7f46781f2490 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4678148d10 con 0x7f46781f2490 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670004230 con 0x7f46781f2490 2024-09-10T11:48:52.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46781492d0 con 0x7f46781f2490 2024-09-10T11:48:52.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.117+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467806ed20 con 0x7f46781f2490 2024-09-10T11:48:52.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.121+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f46700043d0 con 0x7f46781f2490 2024-09-10T11:48:52.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.121+0000 7f466effd640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465c06f710 0x7f465c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:52.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.121+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f467012a7e0 con 0x7f46781f2490 2024-09-10T11:48:52.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.121+0000 7f467e357640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465c06f710 0x7f465c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:52.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.121+0000 7f467e357640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465c06f710 0x7f465c071bd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4674009a30 tx=0x7f46740091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:52.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.125+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f46700c6020 con 0x7f46781f2490 2024-09-10T11:48:52.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.293+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f467815ec00 con 0x7f46781f2490 2024-09-10T11:48:52.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.293+0000 7f466effd640 1 -- 172.21.15.78:0/450418691 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f46700169e0 con 0x7f46781f2490 2024-09-10T11:48:52.298 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:52.298 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465c06f710 msgr2=0x7f465c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465c06f710 0x7f465c071bd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4674009a30 tx=0x7f46740091e0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 msgr2=0x7f46781f2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 0x7f46781f2940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f467001c740 tx=0x7f467000a360 comp rx=0 tx=0).stop 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 shutdown_connections 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f467814aaa0 0x7f467814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465c06f710 0x7f465c071bd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46781f2490 0x7f46781f2940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 --2- 172.21.15.78:0/450418691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46640051d0 0x7f4678148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 >> 172.21.15.78:0/450418691 conn(0x7f46780cf7c0 msgr2=0x7f467806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 shutdown_connections 2024-09-10T11:48:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:52.297+0000 7f46805bb640 1 -- 172.21.15.78:0/450418691 wait complete. 2024-09-10T11:48:55.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f0536b13640 1 -- 172.21.15.78:0/4256998183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 msgr2=0x7f0518003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f0536b13640 1 --2- 172.21.15.78:0/4256998183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f0518003e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0520005fd0 tx=0x7f052001cd30 comp rx=0 tx=0).stop 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f05350b0640 1 -- 172.21.15.78:0/4256998183 reap_dead start 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f0536b13640 1 -- 172.21.15.78:0/4256998183 shutdown_connections 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f0536b13640 1 -- 172.21.15.78:0/4256998183 >> 172.21.15.78:0/4256998183 conn(0x7f05300cf7c0 msgr2=0x7f05300cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f0536b13640 1 -- 172.21.15.78:0/4256998183 shutdown_connections 2024-09-10T11:48:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.449+0000 7f0536b13640 1 -- 172.21.15.78:0/4256998183 wait complete. 2024-09-10T11:48:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 Processor -- start 2024-09-10T11:48:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- start start 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f05301f8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05301fa600 0x7f05300afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f053015e720 0x7f053015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0530154600 con 0x7f0518003a40 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0530154480 con 0x7f053015e720 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0530154780 con 0x7f05301fa600 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f05301f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f05301f8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48996/0 (socket says 172.21.15.78:48996) 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 -- 172.21.15.78:0/725264244 learned_addr learned my addr 172.21.15.78:0/725264244 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05350b0640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f053015e720 0x7f053015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f052ffff640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05301fa600 0x7f05300afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 -- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05301fa600 msgr2=0x7f05300afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05301fa600 0x7f05300afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 -- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f053015e720 msgr2=0x7f053015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f053015e720 0x7f053015ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 -- 172.21.15.78:0/725264244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0530150140 con 0x7f0518003a40 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05350b0640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f053015e720 0x7f053015ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f052ffff640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05301fa600 0x7f05300afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f05348af640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f05301f8940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f052000ba60 tx=0x7f0520005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05200ab040 con 0x7f0518003a40 2024-09-10T11:48:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05200be070 con 0x7f0518003a40 2024-09-10T11:48:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0530150420 con 0x7f0518003a40 2024-09-10T11:48:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520004930 con 0x7f0518003a40 2024-09-10T11:48:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05301509e0 con 0x7f0518003a40 2024-09-10T11:48:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.453+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05300ae940 con 0x7f0518003a40 2024-09-10T11:48:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.457+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f05200b6070 con 0x7f0518003a40 2024-09-10T11:48:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.457+0000 7f052d7fa640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f051c06f710 0x7f051c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.457+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f052012a120 con 0x7f0518003a40 2024-09-10T11:48:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.457+0000 7f052ffff640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f051c06f710 0x7f051c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.457+0000 7f052ffff640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f051c06f710 0x7f051c071bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05300b0900 tx=0x7f0524001da0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:55.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.461+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0520016a70 con 0x7f0518003a40 2024-09-10T11:48:55.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.641+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f053015b8e0 con 0x7f0518003a40 2024-09-10T11:48:55.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.641+0000 7f052d7fa640 1 -- 172.21.15.78:0/725264244 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f05200f70c0 con 0x7f0518003a40 2024-09-10T11:48:55.646 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:55.646 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:55.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f051c06f710 msgr2=0x7f051c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:55.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f051c06f710 0x7f051c071bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05300b0900 tx=0x7f0524001da0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 msgr2=0x7f05301f8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:55.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f05301f8940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f052000ba60 tx=0x7f0520005620 comp rx=0 tx=0).stop 2024-09-10T11:48:55.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 shutdown_connections 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f053015e720 0x7f053015ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f051c06f710 0x7f051c071bd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05301fa600 0x7f05300afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 --2- 172.21.15.78:0/725264244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0518003a40 0x7f05301f8940 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 >> 172.21.15.78:0/725264244 conn(0x7f05300cf7c0 msgr2=0x7f053015d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 shutdown_connections 2024-09-10T11:48:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:55.645+0000 7f0536b13640 1 -- 172.21.15.78:0/725264244 wait complete. 2024-09-10T11:48:58.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:48:58.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 -- 172.21.15.78:0/3931481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17840aef20 msgr2=0x7f17840b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:58.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3931481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17840aef20 0x7f17840b3b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f17840702d0 tx=0x7f177c01dbb0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 -- 172.21.15.78:0/3931481418 shutdown_connections 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3931481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17840aef20 0x7f17840b3b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3931481418 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f178415a010 0x7f17840b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3931481418 >> v2:172.21.15.112:3300/0 conn(0x7f1784159c30 0x7f17840b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 -- 172.21.15.78:0/3931481418 >> 172.21.15.78:0/3931481418 conn(0x7f17840cf7c0 msgr2=0x7f17840cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 -- 172.21.15.78:0/3931481418 shutdown_connections 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.797+0000 7f1789f1e640 1 -- 172.21.15.78:0/3931481418 wait complete. 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 Processor -- start 2024-09-10T11:48:58.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- start start 2024-09-10T11:48:58.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17840aef20 0x7f17841589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:58.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 0x7f178415f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:58.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f178415a010 0x7f178415fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f178415e4d0 con 0x7f1784159c30 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f178415e350 con 0x7f178415a010 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f178415e650 con 0x7f17840aef20 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 0x7f178415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 0x7f178415f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49020/0 (socket says 172.21.15.78:49020) 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 -- 172.21.15.78:0/3461595154 learned_addr learned my addr 172.21.15.78:0/3461595154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f17837fe640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17840aef20 0x7f17841589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1783fff640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f178415a010 0x7f178415fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 -- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17840aef20 msgr2=0x7f17841589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17840aef20 0x7f17841589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 -- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f178415a010 msgr2=0x7f178415fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f178415a010 0x7f178415fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 -- 172.21.15.78:0/3461595154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17841face0 con 0x7f1784159c30 2024-09-10T11:48:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f177affd640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 0x7f178415f690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d720 tx=0x7f176c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c017070 con 0x7f1784159c30 2024-09-10T11:48:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f176c009d20 con 0x7f1784159c30 2024-09-10T11:48:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17841fafc0 con 0x7f1784159c30 2024-09-10T11:48:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c005280 con 0x7f1784159c30 2024-09-10T11:48:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17841fb580 con 0x7f1784159c30 2024-09-10T11:48:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.801+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17840b2870 con 0x7f1784159c30 2024-09-10T11:48:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.805+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f176c005420 con 0x7f1784159c30 2024-09-10T11:48:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.805+0000 7f1780ff9640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f176406f710 0x7f1764071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.805+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f176c08fa30 con 0x7f1784159c30 2024-09-10T11:48:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.805+0000 7f17837fe640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f176406f710 0x7f1764071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.805+0000 7f17837fe640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f176406f710 0x7f1764071bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17740058d0 tx=0x7f1774005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.809+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f176c05c830 con 0x7f1784159c30 2024-09-10T11:48:58.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f17840b4300 con 0x7f1784159c30 2024-09-10T11:48:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1780ff9640 1 -- 172.21.15.78:0/3461595154 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f176c05c130 con 0x7f1784159c30 2024-09-10T11:48:58.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:48:58.988 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:48:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f176406f710 msgr2=0x7f1764071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f176406f710 0x7f1764071bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17740058d0 tx=0x7f1774005860 comp rx=0 tx=0).stop 2024-09-10T11:48:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 msgr2=0x7f178415f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 0x7f178415f690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d720 tx=0x7f176c00dbe0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 shutdown_connections 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f178415a010 0x7f178415fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f176406f710 0x7f1764071bd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1784159c30 0x7f178415f690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 --2- 172.21.15.78:0/3461595154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17840aef20 0x7f17841589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 >> 172.21.15.78:0/3461595154 conn(0x7f17840cf7c0 msgr2=0x7f1784153110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 shutdown_connections 2024-09-10T11:48:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:48:58.985+0000 7f1789f1e640 1 -- 172.21.15.78:0/3461595154 wait complete. 2024-09-10T11:49:02.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- 172.21.15.78:0/23392653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff84004d50 msgr2=0x7eff840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/23392653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff84004d50 0x7eff840051d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7eff90002240 tx=0x7eff9001d300 comp rx=0 tx=0).stop 2024-09-10T11:49:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff96d9d640 1 -- 172.21.15.78:0/23392653 reap_dead start 2024-09-10T11:49:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- 172.21.15.78:0/23392653 shutdown_connections 2024-09-10T11:49:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- 172.21.15.78:0/23392653 >> 172.21.15.78:0/23392653 conn(0x7eff980d3c80 msgr2=0x7eff980d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- 172.21.15.78:0/23392653 shutdown_connections 2024-09-10T11:49:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- 172.21.15.78:0/23392653 wait complete. 2024-09-10T11:49:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 Processor -- start 2024-09-10T11:49:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- start start 2024-09-10T11:49:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff980d1d40 0x7eff980d2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 0x7eff980b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff980b8130 0x7eff9806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff980d4b00 con 0x7eff981605d0 2024-09-10T11:49:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff980d4980 con 0x7eff980b8130 2024-09-10T11:49:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9cc5c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7eff980b4690 con 0x7eff980d1d40 2024-09-10T11:49:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 0x7eff980b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:02.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 0x7eff980b7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54930/0 (socket says 172.21.15.78:54930) 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 -- 172.21.15.78:0/3330765157 learned_addr learned my addr 172.21.15.78:0/3330765157 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff96d9d640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff980b8130 0x7eff9806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff9659c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff980d1d40 0x7eff980d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 -- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff980d1d40 msgr2=0x7eff980d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff980d1d40 0x7eff980d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 -- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff980b8130 msgr2=0x7eff9806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff980b8130 0x7eff9806d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 -- 172.21.15.78:0/3330765157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff981574d0 con 0x7eff981605d0 2024-09-10T11:49:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.148+0000 7eff8dd9b640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 0x7eff980b7bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff80005d10 tx=0x7eff8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8000cc60 con 0x7eff981605d0 2024-09-10T11:49:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff80005020 con 0x7eff981605d0 2024-09-10T11:49:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff980d2660 con 0x7eff981605d0 2024-09-10T11:49:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80005410 con 0x7eff981605d0 2024-09-10T11:49:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff980b8920 con 0x7eff981605d0 2024-09-10T11:49:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff980d0d70 con 0x7eff981605d0 2024-09-10T11:49:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7eff800047b0 con 0x7eff981605d0 2024-09-10T11:49:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff8f7fe640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff7806f740 0x7eff78071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7eff800900d0 con 0x7eff981605d0 2024-09-10T11:49:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff9659c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff7806f740 0x7eff78071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:02.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.152+0000 7eff9659c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff7806f740 0x7eff78071c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff88005fd0 tx=0x7eff88005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.156+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7eff80016030 con 0x7eff981605d0 2024-09-10T11:49:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.332+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7eff981576a0 con 0x7eff981605d0 2024-09-10T11:49:02.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.332+0000 7eff8f7fe640 1 -- 172.21.15.78:0/3330765157 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7eff8005d080 con 0x7eff981605d0 2024-09-10T11:49:02.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:02.338 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:02.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff7806f740 msgr2=0x7eff78071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:02.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff7806f740 0x7eff78071c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff88005fd0 tx=0x7eff88005f40 comp rx=0 tx=0).stop 2024-09-10T11:49:02.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 msgr2=0x7eff980b7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:02.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 0x7eff980b7bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff80005d10 tx=0x7eff8000edf0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 shutdown_connections 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff980b8130 0x7eff9806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff7806f740 0x7eff78071c00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981605d0 0x7eff980b7bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 --2- 172.21.15.78:0/3330765157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff980d1d40 0x7eff980d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 >> 172.21.15.78:0/3330765157 conn(0x7eff980d3c80 msgr2=0x7eff980b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 shutdown_connections 2024-09-10T11:49:02.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:02.336+0000 7eff9cc5c640 1 -- 172.21.15.78:0/3330765157 wait complete. 2024-09-10T11:49:05.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- 172.21.15.78:0/111481101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22815b790 msgr2=0x7fb22815c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/111481101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22815b790 0x7fb22815c7e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb218009c80 tx=0x7fb21801cda0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- 172.21.15.78:0/111481101 shutdown_connections 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/111481101 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2280cc7d0 0x7fb2280ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/111481101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22815b790 0x7fb22815c7e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- 172.21.15.78:0/111481101 >> 172.21.15.78:0/111481101 conn(0x7fb2280d0900 msgr2=0x7fb2280d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- 172.21.15.78:0/111481101 shutdown_connections 2024-09-10T11:49:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- 172.21.15.78:0/111481101 wait complete. 2024-09-10T11:49:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 Processor -- start 2024-09-10T11:49:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- start start 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 0x7fb22814df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2280cc7d0 0x7fb2280c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22815b790 0x7fb22815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280af8c0 con 0x7fb22806f0d0 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280af740 con 0x7fb22815b790 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22f1bb640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280afa40 con 0x7fb2280cc7d0 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 0x7fb22814df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 0x7fb22814df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54942/0 (socket says 172.21.15.78:54942) 2024-09-10T11:49:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 -- 172.21.15.78:0/707479195 learned_addr learned my addr 172.21.15.78:0/707479195 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 -- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2280cc7d0 msgr2=0x7fb2280c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb227fff640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2280cc7d0 0x7fb2280c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2280cc7d0 0x7fb2280c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 -- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22815b790 msgr2=0x7fb22815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22815b790 0x7fb22815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 -- 172.21.15.78:0/707479195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22814e4c0 con 0x7fb22806f0d0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb22cf57640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 0x7fb22814df80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f90 tx=0x7fb2180093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.488+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180bb070 con 0x7fb22806f0d0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb218004e00 con 0x7fb22806f0d0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb228159330 con 0x7fb22806f0d0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180b2040 con 0x7fb22806f0d0 2024-09-10T11:49:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb228159050 con 0x7fb22806f0d0 2024-09-10T11:49:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2280affc0 con 0x7fb22806f0d0 2024-09-10T11:49:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb2180be070 con 0x7fb22806f0d0 2024-09-10T11:49:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb2257fa640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb20806f710 0x7fb208071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb2181295d0 con 0x7fb22806f0d0 2024-09-10T11:49:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb227fff640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb20806f710 0x7fb208071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.492+0000 7fb227fff640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb20806f710 0x7fb208071bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb2280c3f80 tx=0x7fb210008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.496+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb218016990 con 0x7fb22806f0d0 2024-09-10T11:49:05.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.676+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb2280c7700 con 0x7fb22806f0d0 2024-09-10T11:49:05.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.676+0000 7fb2257fa640 1 -- 172.21.15.78:0/707479195 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb2180f64f0 con 0x7fb22806f0d0 2024-09-10T11:49:05.682 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:05.682 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:05.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb20806f710 msgr2=0x7fb208071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb20806f710 0x7fb208071bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb2280c3f80 tx=0x7fb210008040 comp rx=0 tx=0).stop 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 msgr2=0x7fb22814df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 0x7fb22814df80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f90 tx=0x7fb2180093f0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 shutdown_connections 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22815b790 0x7fb22815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb20806f710 0x7fb208071bd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2280cc7d0 0x7fb2280c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 --2- 172.21.15.78:0/707479195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb22806f0d0 0x7fb22814df80 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f90 tx=0x7fb2180093f0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 >> 172.21.15.78:0/707479195 conn(0x7fb2280d0900 msgr2=0x7fb2280d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 shutdown_connections 2024-09-10T11:49:05.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:05.680+0000 7fb22f1bb640 1 -- 172.21.15.78:0/707479195 wait complete. 2024-09-10T11:49:08.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/267517927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a4003a60 msgr2=0x7fc0a4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/267517927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a4003a60 0x7fc0a4003e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c2e0 tx=0x7fc0a001cf30 comp rx=0 tx=0).stop 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/267517927 shutdown_connections 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/267517927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a4003a60 0x7fc0a4003e80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/267517927 >> 172.21.15.78:0/267517927 conn(0x7fc0b80cf7c0 msgr2=0x7fc0b80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/267517927 shutdown_connections 2024-09-10T11:49:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/267517927 wait complete. 2024-09-10T11:49:08.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 Processor -- start 2024-09-10T11:49:08.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- start start 2024-09-10T11:49:08.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4003a60 0x7fc0b8141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:08.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 0x7fc0b815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b814c900 0x7fc0b814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b80b35d0 con 0x7fc0b815cb50 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b80b3450 con 0x7fc0a4003a60 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b80b3750 con 0x7fc0b814c900 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 0x7fc0b815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 0x7fc0b815ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54962/0 (socket says 172.21.15.78:54962) 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 -- 172.21.15.78:0/3432426158 learned_addr learned my addr 172.21.15.78:0/3432426158 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b659c640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4003a60 0x7fc0b8141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b6d9d640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b814c900 0x7fc0b814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 -- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b814c900 msgr2=0x7fc0b814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b814c900 0x7fc0b814cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 -- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4003a60 msgr2=0x7fc0b8141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4003a60 0x7fc0b8141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 -- 172.21.15.78:0/3432426158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b815bfc0 con 0x7fc0b815cb50 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b659c640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4003a60 0x7fc0b8141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0b5d9b640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 0x7fc0b815ba80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800ffa0 tx=0x7fc0a800d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8004b30 con 0x7fc0b815cb50 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0a8004dc0 con 0x7fc0b815cb50 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800c900 con 0x7fc0b815cb50 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b815d050 con 0x7fc0b815cb50 2024-09-10T11:49:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.832+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b815d610 con 0x7fc0b815cb50 2024-09-10T11:49:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.836+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b81516a0 con 0x7fc0b815cb50 2024-09-10T11:49:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.836+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fc0a800caa0 con 0x7fc0b815cb50 2024-09-10T11:49:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.836+0000 7fc0aeffd640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09806f740 0x7fc098071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.836+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc0a8091650 con 0x7fc0b815cb50 2024-09-10T11:49:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.836+0000 7fc0b659c640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09806f740 0x7fc098071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.836+0000 7fc0b659c640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09806f740 0x7fc098071c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00ab000 tx=0x7fc0a0019d70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:08.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:08.840+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fc0a805e570 con 0x7fc0b815cb50 2024-09-10T11:49:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc0b8069310 con 0x7fc0b815cb50 2024-09-10T11:49:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0aeffd640 1 -- 172.21.15.78:0/3432426158 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc0a805de70 con 0x7fc0b815cb50 2024-09-10T11:49:09.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:09.029 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09806f740 msgr2=0x7fc098071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09806f740 0x7fc098071c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00ab000 tx=0x7fc0a0019d70 comp rx=0 tx=0).stop 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 msgr2=0x7fc0b815ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 0x7fc0b815ba80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800ffa0 tx=0x7fc0a800d870 comp rx=0 tx=0).stop 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 shutdown_connections 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc09806f740 0x7fc098071c00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b814c900 0x7fc0b814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b815cb50 0x7fc0b815ba80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 --2- 172.21.15.78:0/3432426158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a4003a60 0x7fc0b8141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 >> 172.21.15.78:0/3432426158 conn(0x7fc0b80cf7c0 msgr2=0x7fc0b80ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 shutdown_connections 2024-09-10T11:49:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:09.024+0000 7fc0bceb0640 1 -- 172.21.15.78:0/3432426158 wait complete. 2024-09-10T11:49:12.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 -- 172.21.15.78:0/40367966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c15f8a0 msgr2=0x7f879c06e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/40367966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c15f8a0 0x7f879c06e100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f879c0d0810 tx=0x7f879801c8c0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 -- 172.21.15.78:0/40367966 shutdown_connections 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/40367966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f879c06e640 0x7f879c15bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/40367966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c15f8a0 0x7f879c06e100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/40367966 >> v2:172.21.15.112:3300/0 conn(0x7f879c0cc090 0x7f879c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.176+0000 7f87a3a2b640 1 -- 172.21.15.78:0/40367966 >> 172.21.15.78:0/40367966 conn(0x7f879c0cf7c0 msgr2=0x7f879c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- 172.21.15.78:0/40367966 shutdown_connections 2024-09-10T11:49:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- 172.21.15.78:0/40367966 wait complete. 2024-09-10T11:49:12.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 Processor -- start 2024-09-10T11:49:12.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- start start 2024-09-10T11:49:12.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 0x7f879c147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f879c0cc090 0x7f879c14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f879c15f8a0 0x7f879c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0ce6f0 con 0x7f879c06e640 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0ce570 con 0x7f879c15f8a0 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f879c0ce870 con 0x7f879c0cc090 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 0x7f879c147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 0x7f879c147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58390/0 (socket says 172.21.15.78:58390) 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 -- 172.21.15.78:0/2577372995 learned_addr learned my addr 172.21.15.78:0/2577372995 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a1fc8640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f879c15f8a0 0x7f879c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a0fc6640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f879c0cc090 0x7f879c14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 -- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f879c0cc090 msgr2=0x7f879c14ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f879c0cc090 0x7f879c14ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 -- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f879c15f8a0 msgr2=0x7f879c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f879c15f8a0 0x7f879c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 -- 172.21.15.78:0/2577372995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c14dad0 con 0x7f879c06e640 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a1fc8640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f879c15f8a0 0x7f879c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a17c7640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 0x7f879c147650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c9a0 tx=0x7f878c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c007c70 con 0x7f879c06e640 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f878c00f450 con 0x7f879c06e640 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c14ddb0 con 0x7f879c06e640 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c00f8a0 con 0x7f879c06e640 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c1483e0 con 0x7f879c06e640 2024-09-10T11:49:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.180+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c15f360 con 0x7f879c06e640 2024-09-10T11:49:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.184+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f878c00fa40 con 0x7f879c06e640 2024-09-10T11:49:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.184+0000 7f8791ffb640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f878006f710 0x7f8780071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.184+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f878c0900c0 con 0x7f879c06e640 2024-09-10T11:49:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.184+0000 7f87a0fc6640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f878006f710 0x7f8780071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.184+0000 7f87a0fc6640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f878006f710 0x7f8780071bd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f87980af000 tx=0x7f879801b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:12.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.188+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f878c014030 con 0x7f879c06e640 2024-09-10T11:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.376+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f879c15f0b0 con 0x7f879c06e640 2024-09-10T11:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.376+0000 7f8791ffb640 1 -- 172.21.15.78:0/2577372995 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f878c05d070 con 0x7f879c06e640 2024-09-10T11:49:12.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:12.381 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.376+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f878006f710 msgr2=0x7f8780071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.376+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f878006f710 0x7f8780071bd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f87980af000 tx=0x7f879801b100 comp rx=0 tx=0).stop 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.376+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 msgr2=0x7f879c147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.376+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 0x7f879c147650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c9a0 tx=0x7f878c00ce60 comp rx=0 tx=0).stop 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 shutdown_connections 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f879c15f8a0 0x7f879c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f878006f710 0x7f8780071bd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f879c0cc090 0x7f879c14ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 --2- 172.21.15.78:0/2577372995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879c06e640 0x7f879c147650 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 >> 172.21.15.78:0/2577372995 conn(0x7f879c0cf7c0 msgr2=0x7f879c159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 shutdown_connections 2024-09-10T11:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:12.380+0000 7f87a3a2b640 1 -- 172.21.15.78:0/2577372995 wait complete. 2024-09-10T11:49:15.402 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:15.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 -- 172.21.15.78:0/1876512671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f406ded0 msgr2=0x7ff2f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/1876512671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f406ded0 0x7ff2f406e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009840 tx=0x7ff2e801f010 comp rx=0 tx=0).stop 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 -- 172.21.15.78:0/1876512671 shutdown_connections 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/1876512671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2f40cdb30 0x7ff2f40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/1876512671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f406ded0 0x7ff2f406e320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 -- 172.21.15.78:0/1876512671 >> 172.21.15.78:0/1876512671 conn(0x7ff2f40cf7c0 msgr2=0x7ff2f40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 -- 172.21.15.78:0/1876512671 shutdown_connections 2024-09-10T11:49:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.528+0000 7ff2fa77b640 1 -- 172.21.15.78:0/1876512671 wait complete. 2024-09-10T11:49:15.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 Processor -- start 2024-09-10T11:49:15.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- start start 2024-09-10T11:49:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2f406ded0 0x7ff2f4151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2f40cdb30 0x7ff2f415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 0x7ff2f41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40ce610 con 0x7ff2f415f270 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40ce490 con 0x7ff2f40cdb30 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40ce790 con 0x7ff2f406ded0 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 0x7ff2f41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 0x7ff2f41562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58404/0 (socket says 172.21.15.78:58404) 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 -- 172.21.15.78:0/133914594 learned_addr learned my addr 172.21.15.78:0/133914594 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f37fe640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2f40cdb30 0x7ff2f415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 -- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2f406ded0 msgr2=0x7ff2f4151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2f406ded0 0x7ff2f4151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 -- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2f40cdb30 msgr2=0x7ff2f415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2f40cdb30 0x7ff2f415a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 -- 172.21.15.78:0/133914594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f4159ad0 con 0x7ff2f415f270 2024-09-10T11:49:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f8d18640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 0x7ff2f41562b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00ea20 tx=0x7ff2ec00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00cde0 con 0x7ff2f415f270 2024-09-10T11:49:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2ec004c40 con 0x7ff2f415f270 2024-09-10T11:49:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f4159db0 con 0x7ff2f415f270 2024-09-10T11:49:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec005280 con 0x7ff2f415f270 2024-09-10T11:49:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f415a370 con 0x7ff2f415f270 2024-09-10T11:49:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.532+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f4151620 con 0x7ff2f415f270 2024-09-10T11:49:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.536+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7ff2ec005420 con 0x7ff2f415f270 2024-09-10T11:49:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.536+0000 7ff2f0ff9640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff2e006f740 0x7ff2e0071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.536+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff2ec0902c0 con 0x7ff2f415f270 2024-09-10T11:49:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.536+0000 7ff2f3fff640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff2e006f740 0x7ff2e0071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.536+0000 7ff2f3fff640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff2e006f740 0x7ff2e0071c00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40046c0 tx=0x7ff2e4007910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:15.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.540+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7ff2ec016030 con 0x7ff2f415f270 2024-09-10T11:49:15.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2f40cecb0 con 0x7ff2f415f270 2024-09-10T11:49:15.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2f0ff9640 1 -- 172.21.15.78:0/133914594 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ff2ec05d140 con 0x7ff2f415f270 2024-09-10T11:49:15.720 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:15.720 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff2e006f740 msgr2=0x7ff2e0071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff2e006f740 0x7ff2e0071c00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40046c0 tx=0x7ff2e4007910 comp rx=0 tx=0).stop 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 msgr2=0x7ff2f41562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 0x7ff2f41562b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00ea20 tx=0x7ff2ec00eee0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 shutdown_connections 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2f40cdb30 0x7ff2f415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff2e006f740 0x7ff2e0071c00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f415f270 0x7ff2f41562b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 --2- 172.21.15.78:0/133914594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2f406ded0 0x7ff2f4151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 >> 172.21.15.78:0/133914594 conn(0x7ff2f40cf7c0 msgr2=0x7ff2f415e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 shutdown_connections 2024-09-10T11:49:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:15.716+0000 7ff2fa77b640 1 -- 172.21.15.78:0/133914594 wait complete. 2024-09-10T11:49:18.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.864+0000 7f1f6053f640 1 -- 172.21.15.78:0/2997731991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f44003a90 msgr2=0x7f1f44003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.864+0000 7f1f6053f640 1 --2- 172.21.15.78:0/2997731991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f44003a90 0x7f1f44003eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1f480016f0 tx=0x7f1f4801c7b0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5eadc640 1 -- 172.21.15.78:0/2997731991 reap_dead start 2024-09-10T11:49:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- 172.21.15.78:0/2997731991 shutdown_connections 2024-09-10T11:49:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- 172.21.15.78:0/2997731991 >> 172.21.15.78:0/2997731991 conn(0x7f1f580cf7c0 msgr2=0x7f1f580cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- 172.21.15.78:0/2997731991 shutdown_connections 2024-09-10T11:49:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- 172.21.15.78:0/2997731991 wait complete. 2024-09-10T11:49:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 Processor -- start 2024-09-10T11:49:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- start start 2024-09-10T11:49:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f44003a90 0x7f1f58151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 0x7f1f5814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f5814ec40 0x7f1f58152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5806ff50 con 0x7f1f5815b5c0 2024-09-10T11:49:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5806fdd0 con 0x7f1f5814ec40 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1f58165b40 con 0x7f1f44003a90 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 0x7f1f5814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 0x7f1f5814e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58418/0 (socket says 172.21.15.78:58418) 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 -- 172.21.15.78:0/1389631266 learned_addr learned my addr 172.21.15.78:0/1389631266 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5eadc640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f5814ec40 0x7f1f58152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5e2db640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f44003a90 0x7f1f58151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 -- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f44003a90 msgr2=0x7f1f58151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f44003a90 0x7f1f58151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 -- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f5814ec40 msgr2=0x7f1f58152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f5814ec40 0x7f1f58152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 -- 172.21.15.78:0/1389631266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f580b0ac0 con 0x7f1f5815b5c0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f5dada640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 0x7f1f5814e5c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000fc80 tx=0x7f1f4000d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011640 con 0x7f1f5815b5c0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f4000fe90 con 0x7f1f5815b5c0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f580b0da0 con 0x7f1f5815b5c0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011a80 con 0x7f1f5815b5c0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.868+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5815d2b0 con 0x7f1f5815b5c0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.872+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f580b35d0 con 0x7f1f5815b5c0 2024-09-10T11:49:18.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.872+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1f40011c20 con 0x7f1f5815b5c0 2024-09-10T11:49:18.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.872+0000 7f1f56ffd640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f3806f710 0x7f1f38071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.872+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1f400906f0 con 0x7f1f5815b5c0 2024-09-10T11:49:18.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.872+0000 7f1f5e2db640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f3806f710 0x7f1f38071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.872+0000 7f1f5e2db640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f3806f710 0x7f1f38071bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f480016c0 tx=0x7f1f480195a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:18.876+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1f4005d610 con 0x7f1f5815b5c0 2024-09-10T11:49:19.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.056+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f580b4300 con 0x7f1f5815b5c0 2024-09-10T11:49:19.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.056+0000 7f1f56ffd640 1 -- 172.21.15.78:0/1389631266 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1f4005cf10 con 0x7f1f5815b5c0 2024-09-10T11:49:19.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:19.061 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f3806f710 msgr2=0x7f1f38071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f3806f710 0x7f1f38071bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f480016c0 tx=0x7f1f480195a0 comp rx=0 tx=0).stop 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 msgr2=0x7f1f5814e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 0x7f1f5814e5c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000fc80 tx=0x7f1f4000d6b0 comp rx=0 tx=0).stop 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 shutdown_connections 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f5814ec40 0x7f1f58152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f3806f710 0x7f1f38071bd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f5815b5c0 0x7f1f5814e5c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 --2- 172.21.15.78:0/1389631266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f44003a90 0x7f1f58151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 >> 172.21.15.78:0/1389631266 conn(0x7f1f580cf7c0 msgr2=0x7f1f58153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 shutdown_connections 2024-09-10T11:49:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:19.060+0000 7f1f6053f640 1 -- 172.21.15.78:0/1389631266 wait complete. 2024-09-10T11:49:19.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:49:19.881 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:49:22.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/633111110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 msgr2=0x7f9044003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 --2- 172.21.15.78:0/633111110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f9044003e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f904c0016c0 tx=0x7f904c01c710 comp rx=0 tx=0).stop 2024-09-10T11:49:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905b7fe640 1 -- 172.21.15.78:0/633111110 reap_dead start 2024-09-10T11:49:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/633111110 shutdown_connections 2024-09-10T11:49:22.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/633111110 >> 172.21.15.78:0/633111110 conn(0x7f905c0cf7c0 msgr2=0x7f905c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:22.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/633111110 shutdown_connections 2024-09-10T11:49:22.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/633111110 wait complete. 2024-09-10T11:49:22.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 Processor -- start 2024-09-10T11:49:22.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- start start 2024-09-10T11:49:22.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f905c14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:22.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f905c1f7890 0x7f905c0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:22.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905c073670 0x7f905c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f905c167870 con 0x7f9044003a40 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1676f0 con 0x7f905c1f7890 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f905c1679f0 con 0x7f905c073670 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f905c14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f905c14c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55852/0 (socket says 172.21.15.78:55852) 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 -- 172.21.15.78:0/342813985 learned_addr learned my addr 172.21.15.78:0/342813985 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905b7fe640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905c073670 0x7f905c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 -- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905c073670 msgr2=0x7f905c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905c073670 0x7f905c0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905a7fc640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f905c1f7890 0x7f905c0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 -- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f905c1f7890 msgr2=0x7f905c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f905c1f7890 0x7f905c0b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 -- 172.21.15.78:0/342813985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c073b80 con 0x7f9044003a40 2024-09-10T11:49:22.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f905affd640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f905c14c960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c10 tx=0x7f904c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0ba070 con 0x7f9044003a40 2024-09-10T11:49:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f904c006500 con 0x7f9044003a40 2024-09-10T11:49:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c073e60 con 0x7f9044003a40 2024-09-10T11:49:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0ad070 con 0x7f9044003a40 2024-09-10T11:49:22.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.212+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c1649f0 con 0x7f9044003a40 2024-09-10T11:49:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.216+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905c0cdf10 con 0x7f9044003a40 2024-09-10T11:49:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.216+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f904c0bd070 con 0x7f9044003a40 2024-09-10T11:49:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.216+0000 7f90437fe640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f904806f710 0x7f9048071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.216+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f904c128f80 con 0x7f9044003a40 2024-09-10T11:49:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.216+0000 7f905a7fc640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f904806f710 0x7f9048071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.216+0000 7f905a7fc640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f904806f710 0x7f9048071bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9050005d90 tx=0x7f9050005c80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:22.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.220+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f904c0164d0 con 0x7f9044003a40 2024-09-10T11:49:22.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.404+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f905c074030 con 0x7f9044003a40 2024-09-10T11:49:22.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.404+0000 7f90437fe640 1 -- 172.21.15.78:0/342813985 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f904c0f5930 con 0x7f9044003a40 2024-09-10T11:49:22.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:22.409 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.404+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f904806f710 msgr2=0x7f9048071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.404+0000 7f906136c640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f904806f710 0x7f9048071bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9050005d90 tx=0x7f9050005c80 comp rx=0 tx=0).stop 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.404+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 msgr2=0x7f905c14c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f905c14c960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c10 tx=0x7f904c003c10 comp rx=0 tx=0).stop 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 shutdown_connections 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f905c1f7890 0x7f905c0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f904806f710 0x7f9048071bd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905c073670 0x7f905c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 --2- 172.21.15.78:0/342813985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9044003a40 0x7f905c14c960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 >> 172.21.15.78:0/342813985 conn(0x7f905c0cf7c0 msgr2=0x7f905c0ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 shutdown_connections 2024-09-10T11:49:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:22.408+0000 7f906136c640 1 -- 172.21.15.78:0/342813985 wait complete. 2024-09-10T11:49:25.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 -- 172.21.15.78:0/1592898518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 msgr2=0x7fa64406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 --2- 172.21.15.78:0/1592898518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64406e320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa6440745d0 tx=0x7fa63801eff0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 -- 172.21.15.78:0/1592898518 shutdown_connections 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 --2- 172.21.15.78:0/1592898518 >> v2:172.21.15.112:3300/0 conn(0x7fa6440cdb30 0x7fa6440cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 --2- 172.21.15.78:0/1592898518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64406e320 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 -- 172.21.15.78:0/1592898518 >> 172.21.15.78:0/1592898518 conn(0x7fa6440cf7c0 msgr2=0x7fa6440cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 -- 172.21.15.78:0/1592898518 shutdown_connections 2024-09-10T11:49:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.560+0000 7fa6493bf640 1 -- 172.21.15.78:0/1592898518 wait complete. 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 Processor -- start 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- start start 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64413aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6440cdb30 0x7fa64414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa64415f270 0x7fa64415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa6440ce610 con 0x7fa64406ded0 2024-09-10T11:49:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6440ce490 con 0x7fa64415f270 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa6440ce790 con 0x7fa6440cdb30 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64413aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64413aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55876/0 (socket says 172.21.15.78:55876) 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 -- 172.21.15.78:0/2875279652 learned_addr learned my addr 172.21.15.78:0/2875279652 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6437fe640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa64415f270 0x7fa64415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6427fc640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6440cdb30 0x7fa64414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 -- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6440cdb30 msgr2=0x7fa64414e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6440cdb30 0x7fa64414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 -- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa64415f270 msgr2=0x7fa64415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa64415f270 0x7fa64415cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 -- 172.21.15.78:0/2875279652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6441f58d0 con 0x7fa64406ded0 2024-09-10T11:49:25.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa642ffd640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64413aaf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa634001ec0 tx=0x7fa63400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:25.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634017070 con 0x7fa64406ded0 2024-09-10T11:49:25.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa634003600 con 0x7fa64406ded0 2024-09-10T11:49:25.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6441f5bb0 con 0x7fa64406ded0 2024-09-10T11:49:25.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634003a50 con 0x7fa64406ded0 2024-09-10T11:49:25.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6441f6170 con 0x7fa64406ded0 2024-09-10T11:49:25.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6440cecb0 con 0x7fa64406ded0 2024-09-10T11:49:25.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa63401a070 con 0x7fa64406ded0 2024-09-10T11:49:25.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.564+0000 7fa62b7fe640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa63006f710 0x7fa630071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:25.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.568+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa63408eab0 con 0x7fa64406ded0 2024-09-10T11:49:25.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.568+0000 7fa6427fc640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa63006f710 0x7fa630071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:25.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.568+0000 7fa6427fc640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa63006f710 0x7fa630071bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6380b2000 tx=0x7fa63801d830 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.568+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fa63405ba60 con 0x7fa64406ded0 2024-09-10T11:49:25.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.760+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa64415ddf0 con 0x7fa64406ded0 2024-09-10T11:49:25.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.760+0000 7fa62b7fe640 1 -- 172.21.15.78:0/2875279652 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa63405b360 con 0x7fa64406ded0 2024-09-10T11:49:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:25.766 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa63006f710 msgr2=0x7fa630071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa63006f710 0x7fa630071bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6380b2000 tx=0x7fa63801d830 comp rx=0 tx=0).stop 2024-09-10T11:49:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 msgr2=0x7fa64413aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64413aaf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa634001ec0 tx=0x7fa63400c890 comp rx=0 tx=0).stop 2024-09-10T11:49:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 shutdown_connections 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa64415f270 0x7fa64415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa63006f710 0x7fa630071bd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6440cdb30 0x7fa64414e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 --2- 172.21.15.78:0/2875279652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa64406ded0 0x7fa64413aaf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 >> 172.21.15.78:0/2875279652 conn(0x7fa6440cf7c0 msgr2=0x7fa6440b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 shutdown_connections 2024-09-10T11:49:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:25.764+0000 7fa6493bf640 1 -- 172.21.15.78:0/2875279652 wait complete. 2024-09-10T11:49:28.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:28.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 -- 172.21.15.78:0/3841406165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a415fa70 msgr2=0x7fd7a406e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 --2- 172.21.15.78:0/3841406165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a415fa70 0x7fd7a406e100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd798009c80 tx=0x7fd79801cda0 comp rx=0 tx=0).stop 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 -- 172.21.15.78:0/3841406165 shutdown_connections 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 --2- 172.21.15.78:0/3841406165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7a406e640 0x7fd7a40cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 --2- 172.21.15.78:0/3841406165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a415fa70 0x7fd7a406e100 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 -- 172.21.15.78:0/3841406165 >> 172.21.15.78:0/3841406165 conn(0x7fd7a40cf7c0 msgr2=0x7fd7a40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 -- 172.21.15.78:0/3841406165 shutdown_connections 2024-09-10T11:49:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.912+0000 7fd7abe46640 1 -- 172.21.15.78:0/3841406165 wait complete. 2024-09-10T11:49:28.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 Processor -- start 2024-09-10T11:49:28.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 -- start start 2024-09-10T11:49:28.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a406e640 0x7fd7a4155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 0x7fd7a41595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7a415fa70 0x7fd7a40b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4168880 con 0x7fd7a40cc090 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4168700 con 0x7fd7a406e640 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a4168a00 con 0x7fd7a415fa70 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 0x7fd7a41595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 0x7fd7a41595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55892/0 (socket says 172.21.15.78:55892) 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 -- 172.21.15.78:0/1498030309 learned_addr learned my addr 172.21.15.78:0/1498030309 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a9be2640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a406e640 0x7fd7a4155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7aa3e3640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7a415fa70 0x7fd7a40b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 -- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7a415fa70 msgr2=0x7fd7a40b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7a415fa70 0x7fd7a40b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 -- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a406e640 msgr2=0x7fd7a4155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a406e640 0x7fd7a4155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 -- 172.21.15.78:0/1498030309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a4160150 con 0x7fd7a40cc090 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a9be2640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a406e640 0x7fd7a4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a93e1640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 0x7fd7a41595f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd798000f90 tx=0x7fd7980a5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7980bb070 con 0x7fd7a40cc090 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd798004e00 con 0x7fd7a40cc090 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a4155b60 con 0x7fd7a40cc090 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7980b2040 con 0x7fd7a40cc090 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.916+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a40af6b0 con 0x7fd7a40cc090 2024-09-10T11:49:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.920+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a40cde60 con 0x7fd7a40cc090 2024-09-10T11:49:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.920+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd7980be070 con 0x7fd7a40cc090 2024-09-10T11:49:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.920+0000 7fd7a27fc640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd79006f710 0x7fd790071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.920+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd7981298d0 con 0x7fd7a40cc090 2024-09-10T11:49:28.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.920+0000 7fd7a9be2640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd79006f710 0x7fd790071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:28.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.920+0000 7fd7a9be2640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd79006f710 0x7fd790071bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7a41f87d0 tx=0x7fd794009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:28.924+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd798016990 con 0x7fd7a40cc090 2024-09-10T11:49:29.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.108+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7a4165b10 con 0x7fd7a40cc090 2024-09-10T11:49:29.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.108+0000 7fd7a27fc640 1 -- 172.21.15.78:0/1498030309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd7980f6880 con 0x7fd7a40cc090 2024-09-10T11:49:29.113 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:29.113 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:29.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd79006f710 msgr2=0x7fd790071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:29.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd79006f710 0x7fd790071bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7a41f87d0 tx=0x7fd794009040 comp rx=0 tx=0).stop 2024-09-10T11:49:29.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 msgr2=0x7fd7a41595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 0x7fd7a41595f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd798000f90 tx=0x7fd7980a5a80 comp rx=0 tx=0).stop 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 shutdown_connections 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd79006f710 0x7fd790071bd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7a415fa70 0x7fd7a40b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40cc090 0x7fd7a41595f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 --2- 172.21.15.78:0/1498030309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a406e640 0x7fd7a4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 >> 172.21.15.78:0/1498030309 conn(0x7fd7a40cf7c0 msgr2=0x7fd7a4151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 shutdown_connections 2024-09-10T11:49:29.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:29.112+0000 7fd7abe46640 1 -- 172.21.15.78:0/1498030309 wait complete. 2024-09-10T11:49:32.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:32.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- 172.21.15.78:0/1395400267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 msgr2=0x7f466406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:32.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1395400267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f466406f870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f46640af360 tx=0x7f465801c770 comp rx=0 tx=0).stop 2024-09-10T11:49:32.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- 172.21.15.78:0/1395400267 shutdown_connections 2024-09-10T11:49:32.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1395400267 >> v2:172.21.15.112:3300/0 conn(0x7f466406fdb0 0x7f4664073450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1395400267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f466406f870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- 172.21.15.78:0/1395400267 >> 172.21.15.78:0/1395400267 conn(0x7f46640cf7c0 msgr2=0x7f46640cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:32.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- 172.21.15.78:0/1395400267 shutdown_connections 2024-09-10T11:49:32.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- 172.21.15.78:0/1395400267 wait complete. 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 Processor -- start 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- start start 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f466406fdb0 0x7f466413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f4664149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4664158180 0x7f466414d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46641674d0 con 0x7f46640b3f40 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4664167350 con 0x7f466406fdb0 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f466ac7b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4664167650 con 0x7f4664158180 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f4664149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f4664149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58110/0 (socket says 172.21.15.78:58110) 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 -- 172.21.15.78:0/1720190414 learned_addr learned my addr 172.21.15.78:0/1720190414 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4668a17640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f466406fdb0 0x7f466413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 -- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4664158180 msgr2=0x7f466414d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4664158180 0x7f466414d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 -- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f466406fdb0 msgr2=0x7f466413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f466406fdb0 0x7f466413b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 -- 172.21.15.78:0/1720190414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466413b740 con 0x7f46640b3f40 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f4663fff640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f4664149830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f465801a3a0 tx=0x7f46580a6b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.264+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580be070 con 0x7f46640b3f40 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46580a6d40 con 0x7f46640b3f40 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46641f8480 con 0x7f46640b3f40 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580052a0 con 0x7f46640b3f40 2024-09-10T11:49:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46641f8a40 con 0x7f46640b3f40 2024-09-10T11:49:32.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4664073450 con 0x7f46640b3f40 2024-09-10T11:49:32.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f4658005440 con 0x7f46640b3f40 2024-09-10T11:49:32.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f46617fa640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465006f710 0x7f4650071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:32.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4658129210 con 0x7f46640b3f40 2024-09-10T11:49:32.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f4668a17640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465006f710 0x7f4650071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:32.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.268+0000 7f4668a17640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465006f710 0x7f4650071bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4654000f70 tx=0x7f4654009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:32.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.272+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f46580ac030 con 0x7f46640b3f40 2024-09-10T11:49:32.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.456+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4664069310 con 0x7f46640b3f40 2024-09-10T11:49:32.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.456+0000 7f46617fa640 1 -- 172.21.15.78:0/1720190414 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f46580163f0 con 0x7f46640b3f40 2024-09-10T11:49:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:32.461 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465006f710 msgr2=0x7f4650071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465006f710 0x7f4650071bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4654000f70 tx=0x7f4654009040 comp rx=0 tx=0).stop 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 msgr2=0x7f4664149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f4664149830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f465801a3a0 tx=0x7f46580a6b10 comp rx=0 tx=0).stop 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 shutdown_connections 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f465006f710 0x7f4650071bd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4664158180 0x7f466414d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46640b3f40 0x7f4664149830 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 --2- 172.21.15.78:0/1720190414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f466406fdb0 0x7f466413b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 >> 172.21.15.78:0/1720190414 conn(0x7f46640cf7c0 msgr2=0x7f466415ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:32.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 shutdown_connections 2024-09-10T11:49:32.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:32.460+0000 7f466ac7b640 1 -- 172.21.15.78:0/1720190414 wait complete. 2024-09-10T11:49:35.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/1009474488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548004810 msgr2=0x7f6548004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 --2- 172.21.15.78:0/1009474488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548004810 0x7f6548004c90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f654c006fd0 tx=0x7f654c01cf40 comp rx=0 tx=0).stop 2024-09-10T11:49:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/1009474488 shutdown_connections 2024-09-10T11:49:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 --2- 172.21.15.78:0/1009474488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6548004810 0x7f6548004c90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/1009474488 >> 172.21.15.78:0/1009474488 conn(0x7f655c0cf7c0 msgr2=0x7f655c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/1009474488 shutdown_connections 2024-09-10T11:49:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/1009474488 wait complete. 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 Processor -- start 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- start start 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548004810 0x7f655c1e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f655c0b0c10 0x7f655c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 0x7f655c1e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f655c15f7d0 con 0x7f655c1e7cc0 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f655c15f650 con 0x7f6548004810 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f655c15f950 con 0x7f655c0b0c10 2024-09-10T11:49:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 0x7f655c1e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 0x7f655c1e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58130/0 (socket says 172.21.15.78:58130) 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 -- 172.21.15.78:0/3191354496 learned_addr learned my addr 172.21.15.78:0/3191354496 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f65623fd640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548004810 0x7f655c1e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6561bfc640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f655c0b0c10 0x7f655c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 -- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f655c0b0c10 msgr2=0x7f655c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f655c0b0c10 0x7f655c0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 -- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548004810 msgr2=0x7f655c1e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548004810 0x7f655c1e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 -- 172.21.15.78:0/3191354496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655c14cb90 con 0x7f655c1e7cc0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6562bfe640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 0x7f655c1e8150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f655c15bc50 tx=0x7f655400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554018070 con 0x7f655c1e7cc0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6554003980 con 0x7f655c1e7cc0 2024-09-10T11:49:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655c14ce70 con 0x7f655c1e7cc0 2024-09-10T11:49:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554003dd0 con 0x7f655c1e7cc0 2024-09-10T11:49:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.612+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655c14d430 con 0x7f655c1e7cc0 2024-09-10T11:49:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.616+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655c15fb30 con 0x7f655c1e7cc0 2024-09-10T11:49:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.616+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f655401b070 con 0x7f655c1e7cc0 2024-09-10T11:49:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.616+0000 7f6552ffd640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f654006f740 0x7f6540071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.616+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f655408eda0 con 0x7f655c1e7cc0 2024-09-10T11:49:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.616+0000 7f65623fd640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f654006f740 0x7f6540071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.616+0000 7f65623fd640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f654006f740 0x7f6540071c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6558009b30 tx=0x7f65580091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.620+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f655405bcd0 con 0x7f655c1e7cc0 2024-09-10T11:49:35.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.804+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f655c14d600 con 0x7f655c1e7cc0 2024-09-10T11:49:35.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.804+0000 7f6552ffd640 1 -- 172.21.15.78:0/3191354496 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f655405b5d0 con 0x7f655c1e7cc0 2024-09-10T11:49:35.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:35.810 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.804+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f654006f740 msgr2=0x7f6540071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.804+0000 7f6564661640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f654006f740 0x7f6540071c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6558009b30 tx=0x7f65580091e0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.804+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 msgr2=0x7f655c1e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.804+0000 7f6564661640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 0x7f655c1e8150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f655c15bc50 tx=0x7f655400db90 comp rx=0 tx=0).stop 2024-09-10T11:49:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 shutdown_connections 2024-09-10T11:49:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f654006f740 0x7f6540071c00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c1e7cc0 0x7f655c1e8150 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f655c0b0c10 0x7f655c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 --2- 172.21.15.78:0/3191354496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6548004810 0x7f655c1e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:35.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 >> 172.21.15.78:0/3191354496 conn(0x7f655c0cf7c0 msgr2=0x7f655c0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:35.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 shutdown_connections 2024-09-10T11:49:35.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:35.808+0000 7f6564661640 1 -- 172.21.15.78:0/3191354496 wait complete. 2024-09-10T11:49:38.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:38.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2660976031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80af840 msgr2=0x7fa4c80ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2660976031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80af840 0x7fa4c80ce5e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8074710 tx=0x7fa4c001cb80 comp rx=0 tx=0).stop 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2660976031 shutdown_connections 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2660976031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80af840 0x7fa4c80ce5e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2660976031 >> v2:172.21.15.112:3300/0 conn(0x7fa4c815f120 0x7fa4c80ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2660976031 >> 172.21.15.78:0/2660976031 conn(0x7fa4c80d19a0 msgr2=0x7fa4c80d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2660976031 shutdown_connections 2024-09-10T11:49:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.960+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2660976031 wait complete. 2024-09-10T11:49:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 Processor -- start 2024-09-10T11:49:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- start start 2024-09-10T11:49:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4c80af840 0x7fa4c8144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 0x7fa4c80c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4c815f120 0x7fa4c80b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c8168cf0 con 0x7fa4c80b09e0 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c8168b70 con 0x7fa4c80af840 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c8168e70 con 0x7fa4c815f120 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 0x7fa4c80c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 0x7fa4c80c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58136/0 (socket says 172.21.15.78:58136) 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 -- 172.21.15.78:0/2700604689 learned_addr learned my addr 172.21.15.78:0/2700604689 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4c7fff640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4c80af840 0x7fa4c8144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4cc91b640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4c815f120 0x7fa4c80b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 -- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4c815f120 msgr2=0x7fa4c80b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4c815f120 0x7fa4c80b7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 -- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4c80af840 msgr2=0x7fa4c8144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4c80af840 0x7fa4c8144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 -- 172.21.15.78:0/2700604689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c8145140 con 0x7fa4c80b09e0 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4bffff640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 0x7fa4c80c8a70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c490 tx=0x7fa4b000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0016020 con 0x7fa4c80b09e0 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4b0012920 con 0x7fa4c80b09e0 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c80c93f0 con 0x7fa4c80b09e0 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0012d50 con 0x7fa4c80b09e0 2024-09-10T11:49:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c80b3080 con 0x7fa4c80b09e0 2024-09-10T11:49:38.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.964+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c80cc260 con 0x7fa4c80b09e0 2024-09-10T11:49:38.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.968+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa4b0019020 con 0x7fa4c80b09e0 2024-09-10T11:49:38.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.968+0000 7fa4c57fa640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa4a806f710 0x7fa4a8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:38.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.968+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa4b008f4e0 con 0x7fa4c80b09e0 2024-09-10T11:49:38.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.968+0000 7fa4c7fff640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa4a806f710 0x7fa4a8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:38.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.968+0000 7fa4c7fff640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa4a806f710 0x7fa4a8071bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80058d0 tx=0x7fa4b8005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:38.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:38.972+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fa4b0020030 con 0x7fa4c80b09e0 2024-09-10T11:49:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.152+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4c80b3280 con 0x7fa4c80b09e0 2024-09-10T11:49:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.152+0000 7fa4c57fa640 1 -- 172.21.15.78:0/2700604689 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa4c8145140 con 0x7fa4c80b09e0 2024-09-10T11:49:39.158 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:39.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa4a806f710 msgr2=0x7fa4a8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:39.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa4a806f710 0x7fa4a8071bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80058d0 tx=0x7fa4b8005860 comp rx=0 tx=0).stop 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 msgr2=0x7fa4c80c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 0x7fa4c80c8a70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c490 tx=0x7fa4b000c950 comp rx=0 tx=0).stop 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 shutdown_connections 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa4a806f710 0x7fa4a8071bd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4c815f120 0x7fa4c80b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4c80b09e0 0x7fa4c80c8a70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 --2- 172.21.15.78:0/2700604689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4c80af840 0x7fa4c8144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 >> 172.21.15.78:0/2700604689 conn(0x7fa4c80d19a0 msgr2=0x7fa4c815cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 shutdown_connections 2024-09-10T11:49:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:39.156+0000 7fa4ce37e640 1 -- 172.21.15.78:0/2700604689 wait complete. 2024-09-10T11:49:42.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2900755373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a41624b0 msgr2=0x7fa5a40d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2900755373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a41624b0 0x7fa5a40d46d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009bc0 tx=0x7fa59c01cb10 comp rx=0 tx=0).stop 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2900755373 shutdown_connections 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2900755373 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a40d0bd0 0x7fa5a40cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2900755373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a41624b0 0x7fa5a40d46d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2900755373 >> 172.21.15.78:0/2900755373 conn(0x7fa5a40d3bb0 msgr2=0x7fa5a40d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2900755373 shutdown_connections 2024-09-10T11:49:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.308+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2900755373 wait complete. 2024-09-10T11:49:42.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 Processor -- start 2024-09-10T11:49:42.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- start start 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a40b4a20 0x7fa5a414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 0x7fa5a41fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a41624b0 0x7fa5a414dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a416af10 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a416ad90 con 0x7fa5a40b4a20 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a416b090 con 0x7fa5a41624b0 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 0x7fa5a41fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 0x7fa5a41fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57330/0 (socket says 172.21.15.78:57330) 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 -- 172.21.15.78:0/2485443727 learned_addr learned my addr 172.21.15.78:0/2485443727 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:42.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a37fe640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a41624b0 0x7fa5a414dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a2ffd640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a40b4a20 0x7fa5a414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 -- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a41624b0 msgr2=0x7fa5a414dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a41624b0 0x7fa5a414dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 -- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a40b4a20 msgr2=0x7fa5a414cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a40b4a20 0x7fa5a414cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 -- 172.21.15.78:0/2485443727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a414d240 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a27fc640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 0x7fa5a41fb2c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c480 tx=0x7fa58c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c017070 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa58c003600 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a41fbca0 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c003a50 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a414d5e0 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a41fc1c0 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.312+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa58c01a070 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.316+0000 7fa59bfff640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f740 0x7fa584071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:42.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.316+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa58c08ec40 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.316+0000 7fa5a2ffd640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f740 0x7fa584071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:42.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.316+0000 7fa5a2ffd640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f740 0x7fa584071c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0af000 tx=0x7fa59c01b350 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:42.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.320+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fa5a41fc1c0 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.492+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5a40cfb70 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.492+0000 7fa59bfff640 1 -- 172.21.15.78:0/2485443727 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa58c095080 con 0x7fa5a40d0bd0 2024-09-10T11:49:42.498 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:42.498 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f740 msgr2=0x7fa584071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f740 0x7fa584071c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0af000 tx=0x7fa59c01b350 comp rx=0 tx=0).stop 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 msgr2=0x7fa5a41fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 0x7fa5a41fb2c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c480 tx=0x7fa58c00c940 comp rx=0 tx=0).stop 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 shutdown_connections 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f740 0x7fa584071c00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a41624b0 0x7fa5a414dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a40d0bd0 0x7fa5a41fb2c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 --2- 172.21.15.78:0/2485443727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a40b4a20 0x7fa5a414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:42.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 >> 172.21.15.78:0/2485443727 conn(0x7fa5a40d3bb0 msgr2=0x7fa5a406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:42.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 shutdown_connections 2024-09-10T11:49:42.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:42.496+0000 7fa5a99ea640 1 -- 172.21.15.78:0/2485443727 wait complete. 2024-09-10T11:49:45.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f190a74a640 1 -- 172.21.15.78:0/1413962606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 msgr2=0x7f18ec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f190a74a640 1 --2- 172.21.15.78:0/1413962606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f18ec003e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18f400bb10 tx=0x7f18f401cde0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f1908ce7640 1 -- 172.21.15.78:0/1413962606 reap_dead start 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f190a74a640 1 -- 172.21.15.78:0/1413962606 shutdown_connections 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f190a74a640 1 -- 172.21.15.78:0/1413962606 >> 172.21.15.78:0/1413962606 conn(0x7f19040cf7c0 msgr2=0x7f19040cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f190a74a640 1 -- 172.21.15.78:0/1413962606 shutdown_connections 2024-09-10T11:49:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.644+0000 7f190a74a640 1 -- 172.21.15.78:0/1413962606 wait complete. 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 Processor -- start 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- start start 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f1904149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1904148c40 0x7f190414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190413ace0 0x7f190413b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1904165340 con 0x7f18ec003a10 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1904072e70 con 0x7f190413ace0 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f19041654c0 con 0x7f1904148c40 2024-09-10T11:49:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f1904149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f1904149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57340/0 (socket says 172.21.15.78:57340) 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 -- 172.21.15.78:0/2601768478 learned_addr learned my addr 172.21.15.78:0/2601768478 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1908ce7640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190413ace0 0x7f190413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 -- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1904148c40 msgr2=0x7f190414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1904148c40 0x7f190414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 -- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190413ace0 msgr2=0x7f190413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190413ace0 0x7f190413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 -- 172.21.15.78:0/2601768478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19040af7c0 con 0x7f18ec003a10 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1903fff640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f1904149af0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f18f401cc10 tx=0x7f18f4005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40ab040 con 0x7f18ec003a10 2024-09-10T11:49:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18f40a59d0 con 0x7f18ec003a10 2024-09-10T11:49:45.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190413b6a0 con 0x7f18ec003a10 2024-09-10T11:49:45.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4004260 con 0x7f18ec003a10 2024-09-10T11:49:45.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19040afd10 con 0x7f18ec003a10 2024-09-10T11:49:45.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.648+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19040b44a0 con 0x7f18ec003a10 2024-09-10T11:49:45.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.652+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f18f40c0020 con 0x7f18ec003a10 2024-09-10T11:49:45.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.652+0000 7f1900ff9640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f18f006f710 0x7f18f0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:45.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.652+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f18f412a940 con 0x7f18ec003a10 2024-09-10T11:49:45.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.652+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f18f4016af0 con 0x7f18ec003a10 2024-09-10T11:49:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.656+0000 7f19037fe640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f18f006f710 0x7f18f0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:45.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.660+0000 7f19037fe640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f18f006f710 0x7f18f0071bd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001250 tx=0x7f18f8001120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1904152af0 con 0x7f18ec003a10 2024-09-10T11:49:45.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f1900ff9640 1 -- 172.21.15.78:0/2601768478 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f18f40f78f0 con 0x7f18ec003a10 2024-09-10T11:49:45.832 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:45.832 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f18f006f710 msgr2=0x7f18f0071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f18f006f710 0x7f18f0071bd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001250 tx=0x7f18f8001120 comp rx=0 tx=0).stop 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 msgr2=0x7f1904149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f1904149af0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f18f401cc10 tx=0x7f18f4005630 comp rx=0 tx=0).stop 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 shutdown_connections 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190413ace0 0x7f190413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f18f006f710 0x7f18f0071bd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1904148c40 0x7f190414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 --2- 172.21.15.78:0/2601768478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18ec003a10 0x7f1904149af0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 >> 172.21.15.78:0/2601768478 conn(0x7f19040cf7c0 msgr2=0x7f1904153010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 shutdown_connections 2024-09-10T11:49:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:45.828+0000 7f190a74a640 1 -- 172.21.15.78:0/2601768478 wait complete. 2024-09-10T11:49:48.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- 172.21.15.78:0/1964344646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cc0004810 msgr2=0x7f2cc0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/1964344646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cc0004810 0x7f2cc0004c90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc006f70 tx=0x7f2ccc01f630 comp rx=0 tx=0).stop 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- 172.21.15.78:0/1964344646 shutdown_connections 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/1964344646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cc0004810 0x7f2cc0004c90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- 172.21.15.78:0/1964344646 >> 172.21.15.78:0/1964344646 conn(0x7f2cd80d3c80 msgr2=0x7f2cd80d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- 172.21.15.78:0/1964344646 shutdown_connections 2024-09-10T11:49:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- 172.21.15.78:0/1964344646 wait complete. 2024-09-10T11:49:48.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 Processor -- start 2024-09-10T11:49:48.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- start start 2024-09-10T11:49:48.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc0004810 0x7f2cd80cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:48.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd80b2210 0x7f2cd80b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:48.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 0x7f2cd80b8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:48.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80d06c0 con 0x7f2cd80b7e80 2024-09-10T11:49:48.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80d0540 con 0x7f2cd80b2210 2024-09-10T11:49:48.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cddbd4640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd80d0840 con 0x7f2cc0004810 2024-09-10T11:49:48.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 0x7f2cd80b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:48.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 0x7f2cd80b8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57354/0 (socket says 172.21.15.78:57354) 2024-09-10T11:49:48.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 -- 172.21.15.78:0/3980750145 learned_addr learned my addr 172.21.15.78:0/3980750145 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd77fe640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc0004810 0x7f2cd80cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd6ffd640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd80b2210 0x7f2cd80b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 -- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc0004810 msgr2=0x7f2cd80cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc0004810 0x7f2cd80cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 -- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd80b2210 msgr2=0x7f2cd80b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd80b2210 0x7f2cd80b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd7fff640 1 -- 172.21.15.78:0/3980750145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd81f80b0 con 0x7f2cd80b7e80 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd6ffd640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd80b2210 0x7f2cd80b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.980+0000 7f2cd77fe640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc0004810 0x7f2cd80cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cd7fff640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 0x7f2cd80b8300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80d34a0 tx=0x7f2cd000fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000dd40 con 0x7f2cd80b7e80 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cd0011440 con 0x7f2cd80b7e80 2024-09-10T11:49:48.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd81f8390 con 0x7f2cd80b7e80 2024-09-10T11:49:48.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011890 con 0x7f2cd80b7e80 2024-09-10T11:49:48.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd80b8bb0 con 0x7f2cd80b7e80 2024-09-10T11:49:48.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd80d0da0 con 0x7f2cd80b7e80 2024-09-10T11:49:48.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f2cd0011a30 con 0x7f2cd80b7e80 2024-09-10T11:49:48.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cbffff640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cc406f710 0x7f2cc4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:48.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2cd0090510 con 0x7f2cd80b7e80 2024-09-10T11:49:48.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cd77fe640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cc406f710 0x7f2cc4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:48.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.984+0000 7f2cd77fe640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cc406f710 0x7f2cc4071bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8154a60 tx=0x7f2cc8006b30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:48.988+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f2cd0022020 con 0x7f2cd80b7e80 2024-09-10T11:49:49.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.172+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2cd80b4030 con 0x7f2cd80b7e80 2024-09-10T11:49:49.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cbffff640 1 -- 172.21.15.78:0/3980750145 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f2cd005d3b0 con 0x7f2cd80b7e80 2024-09-10T11:49:49.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:49.179 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cc406f710 msgr2=0x7f2cc4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cc406f710 0x7f2cc4071bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8154a60 tx=0x7f2cc8006b30 comp rx=0 tx=0).stop 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 msgr2=0x7f2cd80b8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 0x7f2cd80b8300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80d34a0 tx=0x7f2cd000fed0 comp rx=0 tx=0).stop 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 shutdown_connections 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd80b2210 0x7f2cd80b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cc406f710 0x7f2cc4071bd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:49.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd80b7e80 0x7f2cd80b8300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 --2- 172.21.15.78:0/3980750145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc0004810 0x7f2cd80cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 >> 172.21.15.78:0/3980750145 conn(0x7f2cd80d3c80 msgr2=0x7f2cd8157170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 shutdown_connections 2024-09-10T11:49:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:49.176+0000 7f2cddbd4640 1 -- 172.21.15.78:0/3980750145 wait complete. 2024-09-10T11:49:49.986 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:49:49.989 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:49:52.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 -- 172.21.15.78:0/2966697030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 msgr2=0x7ff4180d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 --2- 172.21.15.78:0/2966697030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180d4770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff41808e370 tx=0x7ff40801cb50 comp rx=0 tx=0).stop 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 -- 172.21.15.78:0/2966697030 shutdown_connections 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 --2- 172.21.15.78:0/2966697030 >> v2:172.21.15.112:3300/0 conn(0x7ff418161630 0x7ff4180d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 --2- 172.21.15.78:0/2966697030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180d4770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 -- 172.21.15.78:0/2966697030 >> 172.21.15.78:0/2966697030 conn(0x7ff4180d3c80 msgr2=0x7ff4180d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 -- 172.21.15.78:0/2966697030 shutdown_connections 2024-09-10T11:49:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.324+0000 7ff41cb07640 1 -- 172.21.15.78:0/2966697030 wait complete. 2024-09-10T11:49:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 Processor -- start 2024-09-10T11:49:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- start start 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4180b4a10 0x7ff418152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff418161630 0x7ff4180b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff41816b150 con 0x7ff418161250 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff41816afd0 con 0x7ff418161630 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff41816b2d0 con 0x7ff4180b4a10 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45312/0 (socket says 172.21.15.78:45312) 2024-09-10T11:49:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 -- 172.21.15.78:0/4169086512 learned_addr learned my addr 172.21.15.78:0/4169086512 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41659c640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4180b4a10 0x7ff418152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff416d9d640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff418161630 0x7ff4180b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 -- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4180b4a10 msgr2=0x7ff418152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4180b4a10 0x7ff418152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 -- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff418161630 msgr2=0x7ff4180b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff418161630 0x7ff4180b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 -- 172.21.15.78:0/4169086512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4180b1b80 con 0x7ff418161250 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41659c640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4180b4a10 0x7ff418152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff416d9d640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff418161630 0x7ff4180b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff415d9b640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180b7b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff40000c9f0 tx=0x7ff40000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400007b50 con 0x7ff418161250 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff400007de0 con 0x7ff418161250 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4180d4060 con 0x7ff418161250 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40000f6b0 con 0x7ff418161250 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff418152d60 con 0x7ff418161250 2024-09-10T11:49:52.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.328+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4180d4770 con 0x7ff418161250 2024-09-10T11:49:52.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.332+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7ff40000f850 con 0x7ff418161250 2024-09-10T11:49:52.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.332+0000 7ff40effd640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff3f806f710 0x7ff3f8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:52.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.332+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff40008ffc0 con 0x7ff418161250 2024-09-10T11:49:52.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.332+0000 7ff41659c640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff3f806f710 0x7ff3f8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:52.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.332+0000 7ff41659c640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff3f806f710 0x7ff3f8071bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4080af000 tx=0x7ff40801b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:52.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.336+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7ff400014030 con 0x7ff418161250 2024-09-10T11:49:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff4180d1ae0 con 0x7ff418161250 2024-09-10T11:49:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff40effd640 1 -- 172.21.15.78:0/4169086512 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ff40005d110 con 0x7ff418161250 2024-09-10T11:49:52.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:52.523 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff3f806f710 msgr2=0x7ff3f8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff3f806f710 0x7ff3f8071bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4080af000 tx=0x7ff40801b390 comp rx=0 tx=0).stop 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 msgr2=0x7ff4180b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180b7b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff40000c9f0 tx=0x7ff40000ceb0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 shutdown_connections 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff418161630 0x7ff4180b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7ff3f806f710 0x7ff3f8071bd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff418161250 0x7ff4180b7b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 --2- 172.21.15.78:0/4169086512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4180b4a10 0x7ff418152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 >> 172.21.15.78:0/4169086512 conn(0x7ff4180d3c80 msgr2=0x7ff4180b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 shutdown_connections 2024-09-10T11:49:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:52.520+0000 7ff41cb07640 1 -- 172.21.15.78:0/4169086512 wait complete. 2024-09-10T11:49:55.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:55.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 -- 172.21.15.78:0/1488536662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 msgr2=0x7f8da80b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1488536662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da80b2870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009900 tx=0x7f8da401c820 comp rx=0 tx=0).stop 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 -- 172.21.15.78:0/1488536662 shutdown_connections 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1488536662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8da815a010 0x7f8da80b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1488536662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da80b2870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 -- 172.21.15.78:0/1488536662 >> 172.21.15.78:0/1488536662 conn(0x7f8da80cf7c0 msgr2=0x7f8da80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 -- 172.21.15.78:0/1488536662 shutdown_connections 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.672+0000 7f8daf75a640 1 -- 172.21.15.78:0/1488536662 wait complete. 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 Processor -- start 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- start start 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8da80aef20 0x7f8da8144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da8162810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da815a010 0x7f8da80adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81673a0 con 0x7f8da8159c30 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8167220 con 0x7f8da815a010 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8da8167520 con 0x7f8da80aef20 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da8162810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da8162810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45334/0 (socket says 172.21.15.78:45334) 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 -- 172.21.15.78:0/1622530081 learned_addr learned my addr 172.21.15.78:0/1622530081 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8dad4f6640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8da80aef20 0x7f8da8144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8dadcf7640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da815a010 0x7f8da80adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 -- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8da80aef20 msgr2=0x7f8da8144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8da80aef20 0x7f8da8144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 -- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da815a010 msgr2=0x7f8da80adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da815a010 0x7f8da80adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 -- 172.21.15.78:0/1622530081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81452e0 con 0x7f8da8159c30 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8dadcf7640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da815a010 0x7f8da80adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daccf5640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da8162810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800b410 tx=0x7f8d9800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98015020 con 0x7f8da8159c30 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da81455c0 con 0x7f8da8159c30 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d98011920 con 0x7f8da8159c30 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98011d70 con 0x7f8da8159c30 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da8145e60 con 0x7f8da8159c30 2024-09-10T11:49:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.676+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da81459b0 con 0x7f8da8159c30 2024-09-10T11:49:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.680+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f8d98018020 con 0x7f8da8159c30 2024-09-10T11:49:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.680+0000 7f8d9dffb640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d8c06f710 0x7f8d8c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.680+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8d9808f7b0 con 0x7f8da8159c30 2024-09-10T11:49:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.680+0000 7f8dad4f6640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d8c06f710 0x7f8d8c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.680+0000 7f8dad4f6640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d8c06f710 0x7f8d8c071bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8da40af000 tx=0x7f8da401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.684+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f8d9801f020 con 0x7f8da8159c30 2024-09-10T11:49:55.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.856+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8da80b2870 con 0x7f8da8159c30 2024-09-10T11:49:55.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8d9dffb640 1 -- 172.21.15.78:0/1622530081 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f8d9805c650 con 0x7f8da8159c30 2024-09-10T11:49:55.863 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:55.863 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d8c06f710 msgr2=0x7f8d8c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d8c06f710 0x7f8d8c071bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8da40af000 tx=0x7f8da401b060 comp rx=0 tx=0).stop 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 msgr2=0x7f8da8162810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da8162810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800b410 tx=0x7f8d9800b8d0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 shutdown_connections 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da815a010 0x7f8da80adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d8c06f710 0x7f8d8c071bd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8159c30 0x7f8da8162810 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 --2- 172.21.15.78:0/1622530081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8da80aef20 0x7f8da8144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 >> 172.21.15.78:0/1622530081 conn(0x7f8da80cf7c0 msgr2=0x7f8da80cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 shutdown_connections 2024-09-10T11:49:55.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:55.860+0000 7f8daf75a640 1 -- 172.21.15.78:0/1622530081 wait complete. 2024-09-10T11:49:58.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 -- 172.21.15.78:0/3771371806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c0732d0 msgr2=0x7eff3c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 --2- 172.21.15.78:0/3771371806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c0732d0 0x7eff3c06f870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0cf6f0 tx=0x7eff3001c890 comp rx=0 tx=0).stop 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 -- 172.21.15.78:0/3771371806 shutdown_connections 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 --2- 172.21.15.78:0/3771371806 >> v2:172.21.15.112:3300/0 conn(0x7eff3c06fdb0 0x7eff3c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 --2- 172.21.15.78:0/3771371806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c0732d0 0x7eff3c06f870 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 -- 172.21.15.78:0/3771371806 >> 172.21.15.78:0/3771371806 conn(0x7eff3c0cf7c0 msgr2=0x7eff3c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 -- 172.21.15.78:0/3771371806 shutdown_connections 2024-09-10T11:49:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.008+0000 7eff43029640 1 -- 172.21.15.78:0/3771371806 wait complete. 2024-09-10T11:49:59.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 Processor -- start 2024-09-10T11:49:59.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- start start 2024-09-10T11:49:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c06fdb0 0x7eff3c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0732d0 0x7eff3c1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 0x7eff3c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c167500 con 0x7eff3c15a580 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c167380 con 0x7eff3c0732d0 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7eff3c167680 con 0x7eff3c06fdb0 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 0x7eff3c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 0x7eff3c0ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45340/0 (socket says 172.21.15.78:45340) 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 -- 172.21.15.78:0/645656189 learned_addr learned my addr 172.21.15.78:0/645656189 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff3bfff640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0732d0 0x7eff3c1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff40dc5640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c06fdb0 0x7eff3c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 -- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c06fdb0 msgr2=0x7eff3c0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c06fdb0 0x7eff3c0af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 -- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0732d0 msgr2=0x7eff3c1504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0732d0 0x7eff3c1504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 -- 172.21.15.78:0/645656189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c0afc30 con 0x7eff3c15a580 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff3bfff640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0732d0 0x7eff3c1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff415c6640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 0x7eff3c0ccdb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7eff3400ccb0 tx=0x7eff3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34004b30 con 0x7eff3c15a580 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff34004de0 con 0x7eff3c15a580 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c1f8d90 con 0x7eff3c15a580 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34005280 con 0x7eff3c15a580 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c1f52f0 con 0x7eff3c15a580 2024-09-10T11:49:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3c15c5a0 con 0x7eff3c15a580 2024-09-10T11:49:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.012+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7eff340054e0 con 0x7eff3c15a580 2024-09-10T11:49:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.016+0000 7eff397fa640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff2806f710 0x7eff28071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.016+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7eff34090390 con 0x7eff3c15a580 2024-09-10T11:49:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.016+0000 7eff40dc5640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff2806f710 0x7eff28071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.016+0000 7eff40dc5640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff2806f710 0x7eff28071bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a790 tx=0x7eff2c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.020+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7eff34014030 con 0x7eff3c15a580 2024-09-10T11:49:59.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.204+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7eff3c0cc0f0 con 0x7eff3c15a580 2024-09-10T11:49:59.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.204+0000 7eff397fa640 1 -- 172.21.15.78:0/645656189 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7eff3405d2b0 con 0x7eff3c15a580 2024-09-10T11:49:59.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:49:59.210 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff2806f710 msgr2=0x7eff28071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff2806f710 0x7eff28071bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a790 tx=0x7eff2c008040 comp rx=0 tx=0).stop 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 msgr2=0x7eff3c0ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 0x7eff3c0ccdb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7eff3400ccb0 tx=0x7eff3400a620 comp rx=0 tx=0).stop 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 shutdown_connections 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0732d0 0x7eff3c1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7eff2806f710 0x7eff28071bd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff3c15a580 0x7eff3c0ccdb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 --2- 172.21.15.78:0/645656189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c06fdb0 0x7eff3c0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 >> 172.21.15.78:0/645656189 conn(0x7eff3c0cf7c0 msgr2=0x7eff3c071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 shutdown_connections 2024-09-10T11:49:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:49:59.208+0000 7eff43029640 1 -- 172.21.15.78:0/645656189 wait complete. 2024-09-10T11:50:02.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/3519349370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815a780 msgr2=0x7fc768073c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 --2- 172.21.15.78:0/3519349370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815a780 0x7fc768073c30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc758009bc0 tx=0x7fc75801cb70 comp rx=0 tx=0).stop 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/3519349370 shutdown_connections 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 --2- 172.21.15.78:0/3519349370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815a780 0x7fc768073c30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/3519349370 >> 172.21.15.78:0/3519349370 conn(0x7fc7680d0900 msgr2=0x7fc7680d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/3519349370 shutdown_connections 2024-09-10T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/3519349370 wait complete. 2024-09-10T11:50:02.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 Processor -- start 2024-09-10T11:50:02.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- start start 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7680caf50 0x7fc7680add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76815a780 0x7fc7680b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 0x7fc76814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc768169220 con 0x7fc76815b270 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681690a0 con 0x7fc76815a780 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc7681693a0 con 0x7fc7680caf50 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 0x7fc76814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 0x7fc76814ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53574/0 (socket says 172.21.15.78:53574) 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 -- 172.21.15.78:0/1172637854 learned_addr learned my addr 172.21.15.78:0/1172637854 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc767fff640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76815a780 0x7fc7680b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76cc11640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7680caf50 0x7fc7680add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 -- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7680caf50 msgr2=0x7fc7680add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7680caf50 0x7fc7680add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 -- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76815a780 msgr2=0x7fc7680b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76815a780 0x7fc7680b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 -- 172.21.15.78:0/1172637854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76814e310 con 0x7fc76815b270 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76d412640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 0x7fc76814ddd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c400 tx=0x7fc76000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760011790 con 0x7fc76815b270 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc760017070 con 0x7fc76815b270 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7680ae350 con 0x7fc76815b270 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760011ce0 con 0x7fc76815b270 2024-09-10T11:50:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.364+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7680ae910 con 0x7fc76815b270 2024-09-10T11:50:02.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.368+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc768073c30 con 0x7fc76815b270 2024-09-10T11:50:02.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.368+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fc76001c460 con 0x7fc76815b270 2024-09-10T11:50:02.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.368+0000 7fc7657fa640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc74806f710 0x7fc748071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:02.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.368+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc76008f5d0 con 0x7fc76815b270 2024-09-10T11:50:02.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.368+0000 7fc76cc11640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc74806f710 0x7fc748071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:02.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.368+0000 7fc76cc11640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc74806f710 0x7fc748071bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc7580af000 tx=0x7fc75801b3b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:02.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.372+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fc76005c580 con 0x7fc76815b270 2024-09-10T11:50:02.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.544+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc7681578f0 con 0x7fc76815b270 2024-09-10T11:50:02.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc7657fa640 1 -- 172.21.15.78:0/1172637854 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc76005be80 con 0x7fc76815b270 2024-09-10T11:50:02.551 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:02.551 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:02.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc74806f710 msgr2=0x7fc748071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:02.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc74806f710 0x7fc748071bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc7580af000 tx=0x7fc75801b3b0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 msgr2=0x7fc76814ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 0x7fc76814ddd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c400 tx=0x7fc76000c8c0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 shutdown_connections 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76815a780 0x7fc7680b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc74806f710 0x7fc748071bd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc76815b270 0x7fc76814ddd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 --2- 172.21.15.78:0/1172637854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7680caf50 0x7fc7680add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 >> 172.21.15.78:0/1172637854 conn(0x7fc7680d0900 msgr2=0x7fc7680d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 shutdown_connections 2024-09-10T11:50:02.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:02.548+0000 7fc76ee75640 1 -- 172.21.15.78:0/1172637854 wait complete. 2024-09-10T11:50:05.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- 172.21.15.78:0/3505381139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca415a580 msgr2=0x7f3ca4071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 --2- 172.21.15.78:0/3505381139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca415a580 0x7f3ca4071f30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40cf6f0 tx=0x7f3c9401c7d0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- 172.21.15.78:0/3505381139 shutdown_connections 2024-09-10T11:50:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 --2- 172.21.15.78:0/3505381139 >> v2:172.21.15.112:3300/0 conn(0x7f3ca406ff80 0x7f3ca415c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 --2- 172.21.15.78:0/3505381139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca415a580 0x7f3ca4071f30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- 172.21.15.78:0/3505381139 >> 172.21.15.78:0/3505381139 conn(0x7f3ca40cf7c0 msgr2=0x7f3ca40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- 172.21.15.78:0/3505381139 shutdown_connections 2024-09-10T11:50:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- 172.21.15.78:0/3505381139 wait complete. 2024-09-10T11:50:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 Processor -- start 2024-09-10T11:50:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- start start 2024-09-10T11:50:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ca406ff80 0x7f3ca41f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 0x7f3ca413b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ca415a580 0x7f3ca40b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca4167500 con 0x7f3ca40732d0 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca4167380 con 0x7f3ca415a580 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca9207640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca4167680 con 0x7f3ca406ff80 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 0x7f3ca413b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 0x7f3ca413b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53592/0 (socket says 172.21.15.78:53592) 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 -- 172.21.15.78:0/1993007130 learned_addr learned my addr 172.21.15.78:0/1993007130 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca2d9d640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ca406ff80 0x7f3ca41f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca359e640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ca415a580 0x7f3ca40b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 -- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ca406ff80 msgr2=0x7f3ca41f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ca406ff80 0x7f3ca41f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 -- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ca415a580 msgr2=0x7f3ca40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ca415a580 0x7f3ca40b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca259c640 1 -- 172.21.15.78:0/1993007130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca414afa0 con 0x7f3ca40732d0 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.700+0000 7f3ca359e640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ca415a580 0x7f3ca40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3ca259c640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 0x7f3ca413b040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800c430 tx=0x7f3c9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98017070 con 0x7f3ca40732d0 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c98003600 con 0x7f3ca40732d0 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca414b220 con 0x7f3ca40732d0 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98003a50 con 0x7f3ca40732d0 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca41f8f20 con 0x7f3ca40732d0 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca415c5a0 con 0x7f3ca40732d0 2024-09-10T11:50:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f3c9801a070 con 0x7f3ca40732d0 2024-09-10T11:50:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3c8b7fe640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3c9006f710 0x7f3c90071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3c9808eb50 con 0x7f3ca40732d0 2024-09-10T11:50:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3ca2d9d640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3c9006f710 0x7f3c90071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.704+0000 7f3ca2d9d640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3c9006f710 0x7f3c90071bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c940af000 tx=0x7f3c9401b010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:05.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.708+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f3ca414afa0 con 0x7f3ca40732d0 2024-09-10T11:50:05.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ca414b3f0 con 0x7f3ca40732d0 2024-09-10T11:50:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3c8b7fe640 1 -- 172.21.15.78:0/1993007130 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f3c9805bb00 con 0x7f3ca40732d0 2024-09-10T11:50:05.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:05.891 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3c9006f710 msgr2=0x7f3c90071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3c9006f710 0x7f3c90071bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c940af000 tx=0x7f3c9401b010 comp rx=0 tx=0).stop 2024-09-10T11:50:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 msgr2=0x7f3ca413b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 0x7f3ca413b040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800c430 tx=0x7f3c9800c8f0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 shutdown_connections 2024-09-10T11:50:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ca415a580 0x7f3ca40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3c9006f710 0x7f3c90071bd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca40732d0 0x7f3ca413b040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 --2- 172.21.15.78:0/1993007130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ca406ff80 0x7f3ca41f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 >> 172.21.15.78:0/1993007130 conn(0x7f3ca40cf7c0 msgr2=0x7f3ca4153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 shutdown_connections 2024-09-10T11:50:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:05.888+0000 7f3ca9207640 1 -- 172.21.15.78:0/1993007130 wait complete. 2024-09-10T11:50:08.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 -- 172.21.15.78:0/3696130921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7701582b0 msgr2=0x7fe7700b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 --2- 172.21.15.78:0/3696130921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7701582b0 0x7fe7700b44a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe760009c80 tx=0x7fe76001cd10 comp rx=0 tx=0).stop 2024-09-10T11:50:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 -- 172.21.15.78:0/3696130921 shutdown_connections 2024-09-10T11:50:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 --2- 172.21.15.78:0/3696130921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7700b49e0 0x7fe77006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 --2- 172.21.15.78:0/3696130921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7701582b0 0x7fe7700b44a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 -- 172.21.15.78:0/3696130921 >> 172.21.15.78:0/3696130921 conn(0x7fe7700cf7c0 msgr2=0x7fe7700cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 -- 172.21.15.78:0/3696130921 shutdown_connections 2024-09-10T11:50:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 -- 172.21.15.78:0/3696130921 wait complete. 2024-09-10T11:50:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 Processor -- start 2024-09-10T11:50:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.040+0000 7fe77684f640 1 -- start start 2024-09-10T11:50:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77006fdb0 0x7fe770141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 0x7fe7700b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7701582b0 0x7fe770147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe770167900 con 0x7fe7700b49e0 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe770167780 con 0x7fe77006fdb0 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe770167a80 con 0x7fe7701582b0 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 0x7fe7700b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 0x7fe7700b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53600/0 (socket says 172.21.15.78:53600) 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 -- 172.21.15.78:0/269662446 learned_addr learned my addr 172.21.15.78:0/269662446 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76ffff640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77006fdb0 0x7fe770141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe774dec640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7701582b0 0x7fe770147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 -- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7701582b0 msgr2=0x7fe770147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7701582b0 0x7fe770147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 -- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77006fdb0 msgr2=0x7fe770141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77006fdb0 0x7fe770141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 -- 172.21.15.78:0/269662446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7700b12d0 con 0x7fe7700b49e0 2024-09-10T11:50:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76f7fe640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 0x7fe7700b0d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9f0 tx=0x7fe76400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76400cde0 con 0x7fe7700b49e0 2024-09-10T11:50:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe764004020 con 0x7fe7700b49e0 2024-09-10T11:50:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764004450 con 0x7fe7700b49e0 2024-09-10T11:50:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7700ce400 con 0x7fe7700b49e0 2024-09-10T11:50:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7700ce9c0 con 0x7fe7700b49e0 2024-09-10T11:50:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77006f870 con 0x7fe7700b49e0 2024-09-10T11:50:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fe764003600 con 0x7fe7700b49e0 2024-09-10T11:50:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76cff9640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75c06f710 0x7fe75c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe764090230 con 0x7fe7700b49e0 2024-09-10T11:50:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.044+0000 7fe76ffff640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75c06f710 0x7fe75c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.048+0000 7fe76ffff640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75c06f710 0x7fe75c071bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7600af000 tx=0x7fe76001b550 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:09.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.048+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fe76405d140 con 0x7fe7700b49e0 2024-09-10T11:50:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.228+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe770159fe0 con 0x7fe7700b49e0 2024-09-10T11:50:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.228+0000 7fe76cff9640 1 -- 172.21.15.78:0/269662446 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fe76405ca40 con 0x7fe7700b49e0 2024-09-10T11:50:09.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:09.234 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75c06f710 msgr2=0x7fe75c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75c06f710 0x7fe75c071bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7600af000 tx=0x7fe76001b550 comp rx=0 tx=0).stop 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 msgr2=0x7fe7700b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 0x7fe7700b0d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9f0 tx=0x7fe76400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 shutdown_connections 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75c06f710 0x7fe75c071bd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7701582b0 0x7fe770147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7700b49e0 0x7fe7700b0d90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 --2- 172.21.15.78:0/269662446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77006fdb0 0x7fe770141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 >> 172.21.15.78:0/269662446 conn(0x7fe7700cf7c0 msgr2=0x7fe770158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 shutdown_connections 2024-09-10T11:50:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:09.232+0000 7fe77684f640 1 -- 172.21.15.78:0/269662446 wait complete. 2024-09-10T11:50:12.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 -- 172.21.15.78:0/3527336193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280acfc0 msgr2=0x7f62280cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 --2- 172.21.15.78:0/3527336193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280acfc0 0x7f62280cf8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6228076210 tx=0x7f621001d320 comp rx=0 tx=0).stop 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 -- 172.21.15.78:0/3527336193 shutdown_connections 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 --2- 172.21.15.78:0/3527336193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280acfc0 0x7f62280cf8e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 --2- 172.21.15.78:0/3527336193 >> v2:172.21.15.112:3300/0 conn(0x7f62280cf500 0x7f62280af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 -- 172.21.15.78:0/3527336193 >> 172.21.15.78:0/3527336193 conn(0x7f62280b1ce0 msgr2=0x7f62280b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 -- 172.21.15.78:0/3527336193 shutdown_connections 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.376+0000 7f622caff640 1 -- 172.21.15.78:0/3527336193 wait complete. 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 Processor -- start 2024-09-10T11:50:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- start start 2024-09-10T11:50:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62280acfc0 0x7f6228153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62280af190 0x7f6228154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 0x7f6228154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6228167a30 con 0x7f62280cf500 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62281678b0 con 0x7f62280af190 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6228167bb0 con 0x7f62280acfc0 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 0x7f6228154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 0x7f6228154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47086/0 (socket says 172.21.15.78:47086) 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 -- 172.21.15.78:0/3247600344 learned_addr learned my addr 172.21.15.78:0/3247600344 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6225d9b640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62280af190 0x7f6228154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622659c640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62280acfc0 0x7f6228153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 -- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62280acfc0 msgr2=0x7f6228153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62280acfc0 0x7f6228153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 -- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62280af190 msgr2=0x7f6228154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62280af190 0x7f6228154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 -- 172.21.15.78:0/3247600344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62280c9d90 con 0x7f62280cf500 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f6226d9d640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 0x7f6228154ba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f622000c3c0 tx=0x7f622000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220011790 con 0x7f62280cf500 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6220017070 con 0x7f62280cf500 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62280c9ab0 con 0x7f62280cf500 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220011cc0 con 0x7f62280cf500 2024-09-10T11:50:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622809ae50 con 0x7f62280cf500 2024-09-10T11:50:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62280cf8e0 con 0x7f62280cf500 2024-09-10T11:50:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f622001c460 con 0x7f62280cf500 2024-09-10T11:50:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f621effd640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f620806f710 0x7f6208071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.380+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f622008f610 con 0x7f62280cf500 2024-09-10T11:50:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.384+0000 7f622659c640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f620806f710 0x7f6208071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.384+0000 7f622659c640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f620806f710 0x7f6208071bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6218005c50 tx=0x7f6218005be0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:12.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.384+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f622005c5c0 con 0x7f62280cf500 2024-09-10T11:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f622809b290 con 0x7f62280cf500 2024-09-10T11:50:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f621effd640 1 -- 172.21.15.78:0/3247600344 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f622005bec0 con 0x7f62280cf500 2024-09-10T11:50:12.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:12.567 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f620806f710 msgr2=0x7f6208071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f620806f710 0x7f6208071bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6218005c50 tx=0x7f6218005be0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 msgr2=0x7f6228154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 0x7f6228154ba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f622000c3c0 tx=0x7f622000c880 comp rx=0 tx=0).stop 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 shutdown_connections 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62280af190 0x7f6228154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f620806f710 0x7f6208071bd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62280cf500 0x7f6228154ba0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 --2- 172.21.15.78:0/3247600344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62280acfc0 0x7f6228153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 >> 172.21.15.78:0/3247600344 conn(0x7f62280b1ce0 msgr2=0x7f62280adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:12.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 shutdown_connections 2024-09-10T11:50:12.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:12.564+0000 7f622caff640 1 -- 172.21.15.78:0/3247600344 wait complete. 2024-09-10T11:50:15.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:15.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/3604689209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161630 msgr2=0x7f99d00d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:15.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 --2- 172.21.15.78:0/3604689209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161630 0x7f99d00d4770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f99d00ce260 tx=0x7f99c001c7d0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/3604689209 shutdown_connections 2024-09-10T11:50:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 --2- 172.21.15.78:0/3604689209 >> v2:172.21.15.112:3300/0 conn(0x7f99d00b4a10 0x7f99d00b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 --2- 172.21.15.78:0/3604689209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161630 0x7f99d00d4770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/3604689209 >> 172.21.15.78:0/3604689209 conn(0x7f99d00d3c80 msgr2=0x7f99d00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/3604689209 shutdown_connections 2024-09-10T11:50:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/3604689209 wait complete. 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 Processor -- start 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- start start 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d00b4a10 0x7f99d0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 0x7f99d00cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d0161630 0x7f99d01fb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99d016ab40 con 0x7f99d0161250 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00b46f0 con 0x7f99d0161630 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f99d016acc0 con 0x7f99d00b4a10 2024-09-10T11:50:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 0x7f99d00cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 0x7f99d00cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47106/0 (socket says 172.21.15.78:47106) 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 -- 172.21.15.78:0/1434935310 learned_addr learned my addr 172.21.15.78:0/1434935310 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 -- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d00b4a10 msgr2=0x7f99d0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d00b4a10 0x7f99d0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 -- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d0161630 msgr2=0x7f99d01fb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d0161630 0x7f99d01fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 -- 172.21.15.78:0/1434935310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d015e3a0 con 0x7f99d0161250 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d55ec640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 0x7f99d00cbb20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f99c001ccb0 tx=0x7f99c0005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c00b2040 con 0x7f99d0161250 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99c0004040 con 0x7f99d0161250 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d00cc1b0 con 0x7f99d0161250 2024-09-10T11:50:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0004470 con 0x7f99d0161250 2024-09-10T11:50:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.720+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d01fa870 con 0x7f99d0161250 2024-09-10T11:50:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.724+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d00b33a0 con 0x7f99d0161250 2024-09-10T11:50:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.724+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f99c00bd030 con 0x7f99d0161250 2024-09-10T11:50:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.724+0000 7f99c67fc640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f99b406f710 0x7f99b4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.724+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f99c01293e0 con 0x7f99d0161250 2024-09-10T11:50:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.724+0000 7f99d5ded640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f99b406f710 0x7f99b4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.724+0000 7f99d5ded640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f99b406f710 0x7f99b4071bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0046c0 tx=0x7f99cc007910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.728+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f99c00c4020 con 0x7f99d0161250 2024-09-10T11:50:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.916+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f99d01fa620 con 0x7f99d0161250 2024-09-10T11:50:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99c67fc640 1 -- 172.21.15.78:0/1434935310 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f99c00163f0 con 0x7f99d0161250 2024-09-10T11:50:15.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:15.923 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f99b406f710 msgr2=0x7f99b4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f99b406f710 0x7f99b4071bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0046c0 tx=0x7f99cc007910 comp rx=0 tx=0).stop 2024-09-10T11:50:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 msgr2=0x7f99d00cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 0x7f99d00cbb20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f99c001ccb0 tx=0x7f99c0005ca0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 shutdown_connections 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d0161630 0x7f99d01fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f99b406f710 0x7f99b4071bd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99d0161250 0x7f99d00cbb20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 --2- 172.21.15.78:0/1434935310 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d00b4a10 0x7f99d0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 >> 172.21.15.78:0/1434935310 conn(0x7f99d00d3c80 msgr2=0x7f99d00b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 shutdown_connections 2024-09-10T11:50:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:15.920+0000 7f99d8051640 1 -- 172.21.15.78:0/1434935310 wait complete. 2024-09-10T11:50:18.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 -- 172.21.15.78:0/2562969718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31015a580 msgr2=0x7fd310071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 --2- 172.21.15.78:0/2562969718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31015a580 0x7fd310071f30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd31015e130 tx=0x7fd30c01c5d0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 -- 172.21.15.78:0/2562969718 shutdown_connections 2024-09-10T11:50:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 --2- 172.21.15.78:0/2562969718 >> v2:172.21.15.112:3300/0 conn(0x7fd31006fdb0 0x7fd31015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 --2- 172.21.15.78:0/2562969718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3100732d0 0x7fd31006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 --2- 172.21.15.78:0/2562969718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31015a580 0x7fd310071f30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 -- 172.21.15.78:0/2562969718 >> 172.21.15.78:0/2562969718 conn(0x7fd3100cf7c0 msgr2=0x7fd3100cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 -- 172.21.15.78:0/2562969718 shutdown_connections 2024-09-10T11:50:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.072+0000 7fd31875c640 1 -- 172.21.15.78:0/2562969718 wait complete. 2024-09-10T11:50:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 Processor -- start 2024-09-10T11:50:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- start start 2024-09-10T11:50:19.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd31006fdb0 0x7fd3100b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:19.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 0x7fd31014dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:19.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd31015a580 0x7fd3100b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd31006ed40 con 0x7fd3100732d0 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd31006ebc0 con 0x7fd31015a580 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd31006eec0 con 0x7fd31006fdb0 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 0x7fd31014dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 0x7fd31014dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47124/0 (socket says 172.21.15.78:47124) 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 -- 172.21.15.78:0/4272311838 learned_addr learned my addr 172.21.15.78:0/4272311838 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd3164f8640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd31006fdb0 0x7fd3100b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd316cf9640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd31015a580 0x7fd3100b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 -- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd31006fdb0 msgr2=0x7fd3100b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd31006fdb0 0x7fd3100b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 -- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd31015a580 msgr2=0x7fd3100b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd31015a580 0x7fd3100b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 -- 172.21.15.78:0/4272311838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31014fb60 con 0x7fd3100732d0 2024-09-10T11:50:19.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd315cf7640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 0x7fd31014dfe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd30000d980 tx=0x7fd30000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:19.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300017070 con 0x7fd3100732d0 2024-09-10T11:50:19.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd300009d20 con 0x7fd3100732d0 2024-09-10T11:50:19.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3000106c0 con 0x7fd3100732d0 2024-09-10T11:50:19.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31014eac0 con 0x7fd3100732d0 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31014f080 con 0x7fd3100732d0 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.076+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31015e1f0 con 0x7fd3100732d0 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.080+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd30001a070 con 0x7fd3100732d0 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.080+0000 7fd306ffd640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd2f406f710 0x7fd2f4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.080+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd30008f960 con 0x7fd3100732d0 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.080+0000 7fd3164f8640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd2f406f710 0x7fd2f4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:19.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.080+0000 7fd3164f8640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd2f406f710 0x7fd2f4071bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0ae000 tx=0x7fd30c01ae10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:19.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.084+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd30005c910 con 0x7fd3100732d0 2024-09-10T11:50:19.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.268+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd3100b3c70 con 0x7fd3100732d0 2024-09-10T11:50:19.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.268+0000 7fd306ffd640 1 -- 172.21.15.78:0/4272311838 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd30005c210 con 0x7fd3100732d0 2024-09-10T11:50:19.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:19.274 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd2f406f710 msgr2=0x7fd2f4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd2f406f710 0x7fd2f4071bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0ae000 tx=0x7fd30c01ae10 comp rx=0 tx=0).stop 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 msgr2=0x7fd31014dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 0x7fd31014dfe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd30000d980 tx=0x7fd30000de40 comp rx=0 tx=0).stop 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 shutdown_connections 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd31015a580 0x7fd3100b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd2f406f710 0x7fd2f4071bd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3100732d0 0x7fd31014dfe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 --2- 172.21.15.78:0/4272311838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd31006fdb0 0x7fd3100b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:19.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 >> 172.21.15.78:0/4272311838 conn(0x7fd3100cf7c0 msgr2=0x7fd3100b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:19.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 shutdown_connections 2024-09-10T11:50:19.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:19.272+0000 7fd31875c640 1 -- 172.21.15.78:0/4272311838 wait complete. 2024-09-10T11:50:20.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:50:20.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:50:22.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2398039522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbde8003a60 msgr2=0x7fbde8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 --2- 172.21.15.78:0/2398039522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbde8003a60 0x7fbde8003e80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00016f0 tx=0x7fbdf001c720 comp rx=0 tx=0).stop 2024-09-10T11:50:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2398039522 shutdown_connections 2024-09-10T11:50:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 --2- 172.21.15.78:0/2398039522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbde8003a60 0x7fbde8003e80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2398039522 >> 172.21.15.78:0/2398039522 conn(0x7fbe000cf7c0 msgr2=0x7fbe000cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2398039522 shutdown_connections 2024-09-10T11:50:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2398039522 wait complete. 2024-09-10T11:50:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 Processor -- start 2024-09-10T11:50:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- start start 2024-09-10T11:50:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbde8003a60 0x7fbe001f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 0x7fbe0014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe00157fd0 0x7fbe00158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0015ea50 con 0x7fbe000a94c0 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0015e8d0 con 0x7fbe00157fd0 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0015ebd0 con 0x7fbde8003a60 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 0x7fbe0014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 0x7fbe0014a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59134/0 (socket says 172.21.15.78:59134) 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 -- 172.21.15.78:0/2457871006 learned_addr learned my addr 172.21.15.78:0/2457871006 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdff59e640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe00157fd0 0x7fbe00158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfed9d640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbde8003a60 0x7fbe001f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 -- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbde8003a60 msgr2=0x7fbe001f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbde8003a60 0x7fbe001f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 -- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe00157fd0 msgr2=0x7fbe00158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe00157fd0 0x7fbe00158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 -- 172.21.15.78:0/2457871006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe001f92a0 con 0x7fbe000a94c0 2024-09-10T11:50:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbdfe59c640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 0x7fbe0014a130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e9a0 tx=0x7fbdf400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400cc60 con 0x7fbe000a94c0 2024-09-10T11:50:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdf400ce00 con 0x7fbe000a94c0 2024-09-10T11:50:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe001f9580 con 0x7fbe000a94c0 2024-09-10T11:50:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4005280 con 0x7fbe000a94c0 2024-09-10T11:50:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.424+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe00152880 con 0x7fbe000a94c0 2024-09-10T11:50:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.428+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe00158990 con 0x7fbe000a94c0 2024-09-10T11:50:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.428+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fbdf4005420 con 0x7fbe000a94c0 2024-09-10T11:50:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.428+0000 7fbde77fe640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbdec06f740 0x7fbdec071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.428+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fbdf408ffc0 con 0x7fbe000a94c0 2024-09-10T11:50:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.428+0000 7fbdfed9d640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbdec06f740 0x7fbdec071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.428+0000 7fbdfed9d640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbdec06f740 0x7fbdec071c00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00016c0 tx=0x7fbdf0019510 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.432+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fbdf405cf70 con 0x7fbe000a94c0 2024-09-10T11:50:22.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.616+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbe0015c5a0 con 0x7fbe000a94c0 2024-09-10T11:50:22.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.616+0000 7fbde77fe640 1 -- 172.21.15.78:0/2457871006 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fbdf405c870 con 0x7fbe000a94c0 2024-09-10T11:50:22.622 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:22.623 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbdec06f740 msgr2=0x7fbdec071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbdec06f740 0x7fbdec071c00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00016c0 tx=0x7fbdf0019510 comp rx=0 tx=0).stop 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 msgr2=0x7fbe0014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 0x7fbe0014a130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e9a0 tx=0x7fbdf400ee60 comp rx=0 tx=0).stop 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 shutdown_connections 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe00157fd0 0x7fbe00158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbdec06f740 0x7fbdec071c00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe000a94c0 0x7fbe0014a130 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 --2- 172.21.15.78:0/2457871006 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbde8003a60 0x7fbe001f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 >> 172.21.15.78:0/2457871006 conn(0x7fbe000cf7c0 msgr2=0x7fbe000b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 shutdown_connections 2024-09-10T11:50:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:22.620+0000 7fbe05114640 1 -- 172.21.15.78:0/2457871006 wait complete. 2024-09-10T11:50:25.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 -- 172.21.15.78:0/340003289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 msgr2=0x7f4f500cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 --2- 172.21.15.78:0/340003289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500cfcd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009900 tx=0x7f4f4401c8e0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 -- 172.21.15.78:0/340003289 shutdown_connections 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 --2- 172.21.15.78:0/340003289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f500708f0 0x7f4f50070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 --2- 172.21.15.78:0/340003289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500cfcd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 -- 172.21.15.78:0/340003289 >> 172.21.15.78:0/340003289 conn(0x7f4f500d19f0 msgr2=0x7f4f500d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 -- 172.21.15.78:0/340003289 shutdown_connections 2024-09-10T11:50:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 -- 172.21.15.78:0/340003289 wait complete. 2024-09-10T11:50:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 Processor -- start 2024-09-10T11:50:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.772+0000 7f4f54c19640 1 -- start start 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f500708f0 0x7f4f5014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f500ca740 0x7f4f5006f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50168bf0 con 0x7f4f500cf140 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50168a70 con 0x7f4f500708f0 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4f50168d70 con 0x7f4f500ca740 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59148/0 (socket says 172.21.15.78:59148) 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 -- 172.21.15.78:0/4100291057 learned_addr learned my addr 172.21.15.78:0/4100291057 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4ed9d640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f500ca740 0x7f4f5006f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4e59c640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f500708f0 0x7f4f5014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 -- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f500ca740 msgr2=0x7f4f5006f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f500ca740 0x7f4f5006f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 -- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f500708f0 msgr2=0x7f4f5014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f500708f0 0x7f4f5014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 -- 172.21.15.78:0/4100291057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5014b4e0 con 0x7f4f500cf140 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f4dd9b640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500ca200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4f4401a510 tx=0x7f4f44004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f440b2040 con 0x7f4f500cf140 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f44005030 con 0x7f4f500cf140 2024-09-10T11:50:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44005440 con 0x7f4f500cf140 2024-09-10T11:50:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f500b3bf0 con 0x7f4f500cf140 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f500cb050 con 0x7f4f500cf140 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f50070da0 con 0x7f4f500cf140 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.776+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f4f440bd060 con 0x7f4f500cf140 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.780+0000 7f4f3effd640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4f3006f710 0x7f4f30071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.780+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4f44128d80 con 0x7f4f500cf140 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.780+0000 7f4f4e59c640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4f3006f710 0x7f4f30071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.780+0000 7f4f4e59c640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4f3006f710 0x7f4f30071bd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f40001650 tx=0x7f4f40009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.784+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f4f440164d0 con 0x7f4f500cf140 2024-09-10T11:50:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.964+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4f5006a040 con 0x7f4f500cf140 2024-09-10T11:50:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.964+0000 7f4f3effd640 1 -- 172.21.15.78:0/4100291057 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f4f440f5d30 con 0x7f4f500cf140 2024-09-10T11:50:25.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:25.970 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4f3006f710 msgr2=0x7f4f30071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4f3006f710 0x7f4f30071bd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f40001650 tx=0x7f4f40009040 comp rx=0 tx=0).stop 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 msgr2=0x7f4f500ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500ca200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4f4401a510 tx=0x7f4f44004040 comp rx=0 tx=0).stop 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 shutdown_connections 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f4f3006f710 0x7f4f30071bd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f500ca740 0x7f4f5006f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500cf140 0x7f4f500ca200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 --2- 172.21.15.78:0/4100291057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f500708f0 0x7f4f5014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 >> 172.21.15.78:0/4100291057 conn(0x7f4f500d19f0 msgr2=0x7f4f50156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 shutdown_connections 2024-09-10T11:50:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:25.968+0000 7f4f54c19640 1 -- 172.21.15.78:0/4100291057 wait complete. 2024-09-10T11:50:28.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:29.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 -- 172.21.15.78:0/4034346586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 msgr2=0x7febdc0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 --2- 172.21.15.78:0/4034346586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 0x7febdc0b2870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febcc009900 tx=0x7febcc01c820 comp rx=0 tx=0).stop 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 -- 172.21.15.78:0/4034346586 shutdown_connections 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 --2- 172.21.15.78:0/4034346586 >> v2:172.21.15.112:3300/0 conn(0x7febdc0b3ce0 0x7febdc06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 --2- 172.21.15.78:0/4034346586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 0x7febdc0b2870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 -- 172.21.15.78:0/4034346586 >> 172.21.15.78:0/4034346586 conn(0x7febdc0cf7c0 msgr2=0x7febdc0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 -- 172.21.15.78:0/4034346586 shutdown_connections 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.120+0000 7febe301f640 1 -- 172.21.15.78:0/4034346586 wait complete. 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 Processor -- start 2024-09-10T11:50:29.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- start start 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 0x7febdc1f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 0x7febdc13cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febdc15a010 0x7febdc13d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7febdc06fdd0 con 0x7febdc0b3ce0 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7febdc06fc50 con 0x7febdc15a010 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7febdc06ff50 con 0x7febdc159c30 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 0x7febdc1f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 0x7febdc1f94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59158/0 (socket says 172.21.15.78:59158) 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 -- 172.21.15.78:0/1442518610 learned_addr learned my addr 172.21.15.78:0/1442518610 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febdbfff640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 0x7febdc13cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe15bc640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febdc15a010 0x7febdc13d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 -- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 msgr2=0x7febdc13cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 0x7febdc13cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 -- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febdc15a010 msgr2=0x7febdc13d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febdc15a010 0x7febdc13d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 -- 172.21.15.78:0/1442518610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc1fa1a0 con 0x7febdc0b3ce0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe15bc640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febdc15a010 0x7febdc13d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe0dbb640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 0x7febdc1f94c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7febcc009850 tx=0x7febcc0a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc0b2040 con 0x7febdc0b3ce0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febcc004400 con 0x7febdc0b3ce0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febdc1507c0 con 0x7febdc0b3ce0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc0052d0 con 0x7febdc0b3ce0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febdc150a60 con 0x7febdc0b3ce0 2024-09-10T11:50:29.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.124+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febdc06ec40 con 0x7febdc0b3ce0 2024-09-10T11:50:29.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.128+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7febcc005470 con 0x7febdc0b3ce0 2024-09-10T11:50:29.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.128+0000 7febd97fa640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7febc406f710 0x7febc4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.128+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7febcc129370 con 0x7febdc0b3ce0 2024-09-10T11:50:29.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.128+0000 7febdbfff640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7febc406f710 0x7febc4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.128+0000 7febdbfff640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7febc406f710 0x7febc4071bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7febdc14dc00 tx=0x7febc8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:29.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.132+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7febcc0164d0 con 0x7febdc0b3ce0 2024-09-10T11:50:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.316+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7febdc0b4300 con 0x7febdc0b3ce0 2024-09-10T11:50:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.316+0000 7febd97fa640 1 -- 172.21.15.78:0/1442518610 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7febcc0f6290 con 0x7febdc0b3ce0 2024-09-10T11:50:29.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:29.320 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:29.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7febc406f710 msgr2=0x7febc4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7febc406f710 0x7febc4071bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7febdc14dc00 tx=0x7febc8009040 comp rx=0 tx=0).stop 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 msgr2=0x7febdc1f94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 0x7febdc1f94c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7febcc009850 tx=0x7febcc0a5770 comp rx=0 tx=0).stop 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 shutdown_connections 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febdc15a010 0x7febdc13d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7febc406f710 0x7febc4071bd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febdc159c30 0x7febdc13cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 --2- 172.21.15.78:0/1442518610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febdc0b3ce0 0x7febdc1f94c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 >> 172.21.15.78:0/1442518610 conn(0x7febdc0cf7c0 msgr2=0x7febdc0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 shutdown_connections 2024-09-10T11:50:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:29.320+0000 7febe301f640 1 -- 172.21.15.78:0/1442518610 wait complete. 2024-09-10T11:50:32.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 -- 172.21.15.78:0/772497488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d80b3ce0 msgr2=0x7f59d806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 --2- 172.21.15.78:0/772497488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d80b3ce0 0x7f59d806ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f59d80702d0 tx=0x7f59d001cac0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 -- 172.21.15.78:0/772497488 shutdown_connections 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 --2- 172.21.15.78:0/772497488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d80b3ce0 0x7f59d806ec40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 --2- 172.21.15.78:0/772497488 >> v2:172.21.15.112:3300/0 conn(0x7f59d8159c30 0x7f59d80b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 -- 172.21.15.78:0/772497488 >> 172.21.15.78:0/772497488 conn(0x7f59d80cf7c0 msgr2=0x7f59d80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 -- 172.21.15.78:0/772497488 shutdown_connections 2024-09-10T11:50:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.472+0000 7f59dc954640 1 -- 172.21.15.78:0/772497488 wait complete. 2024-09-10T11:50:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 Processor -- start 2024-09-10T11:50:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- start start 2024-09-10T11:50:32.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d80b3ce0 0x7f59d8151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59d8159c30 0x7f59d8151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 0x7f59d81fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59d806fcc0 con 0x7f59d815a010 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59d806fb40 con 0x7f59d80b3ce0 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f59d806fe40 con 0x7f59d8159c30 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 0x7f59d81fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 0x7f59d81fa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45940/0 (socket says 172.21.15.78:45940) 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 -- 172.21.15.78:0/843954466 learned_addr learned my addr 172.21.15.78:0/843954466 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d659c640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d80b3ce0 0x7f59d8151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59cffff640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59d8159c30 0x7f59d8151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 -- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59d8159c30 msgr2=0x7f59d8151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59d8159c30 0x7f59d8151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 -- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d80b3ce0 msgr2=0x7f59d8151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d80b3ce0 0x7f59d8151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 -- 172.21.15.78:0/843954466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d8152910 con 0x7f59d815a010 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59d6d9d640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 0x7f59d81fa7d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009b10 tx=0x7f59d0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00bb070 con 0x7f59d815a010 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59d0004d40 con 0x7f59d815a010 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d8163580 con 0x7f59d815a010 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00b2040 con 0x7f59d815a010 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d815ec80 con 0x7f59d815a010 2024-09-10T11:50:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d806ec40 con 0x7f59d815a010 2024-09-10T11:50:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.476+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f59d00be070 con 0x7f59d815a010 2024-09-10T11:50:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.480+0000 7f59ceffd640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f59b806f740 0x7f59b8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.480+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f59d0129600 con 0x7f59d815a010 2024-09-10T11:50:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.480+0000 7f59d659c640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f59b806f740 0x7f59b8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.480+0000 7f59d659c640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f59b806f740 0x7f59b8071c00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59c80058d0 tx=0x7f59c8005c70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:32.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.484+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f59d0016770 con 0x7f59d815a010 2024-09-10T11:50:32.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.664+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f59d80b4300 con 0x7f59d815a010 2024-09-10T11:50:32.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.664+0000 7f59ceffd640 1 -- 172.21.15.78:0/843954466 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f59d00f65b0 con 0x7f59d815a010 2024-09-10T11:50:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:32.671 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f59b806f740 msgr2=0x7f59b8071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f59b806f740 0x7f59b8071c00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59c80058d0 tx=0x7f59c8005c70 comp rx=0 tx=0).stop 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 msgr2=0x7f59d81fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 0x7f59d81fa7d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009b10 tx=0x7f59d0009300 comp rx=0 tx=0).stop 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 shutdown_connections 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f59b806f740 0x7f59b8071c00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d815a010 0x7f59d81fa7d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59d8159c30 0x7f59d8151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 --2- 172.21.15.78:0/843954466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d80b3ce0 0x7f59d8151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 >> 172.21.15.78:0/843954466 conn(0x7f59d80cf7c0 msgr2=0x7f59d8157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 shutdown_connections 2024-09-10T11:50:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:32.668+0000 7f59dc954640 1 -- 172.21.15.78:0/843954466 wait complete. 2024-09-10T11:50:35.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:35.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2688939036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6b40040c0 msgr2=0x7fa6b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2688939036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6b40040c0 0x7fa6b4004810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00016c0 tx=0x7fa6c001c750 comp rx=0 tx=0).stop 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 -- 172.21.15.78:0/2688939036 reap_dead start 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2688939036 shutdown_connections 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2688939036 >> 172.21.15.78:0/2688939036 conn(0x7fa6cc0cf7c0 msgr2=0x7fa6cc0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2688939036 shutdown_connections 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2688939036 wait complete. 2024-09-10T11:50:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 Processor -- start 2024-09-10T11:50:35.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- start start 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6b40040c0 0x7fa6cc1f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6cc1f8a40 0x7fa6cc15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 0x7fa6cc162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc06fe60 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc06fce0 con 0x7fa6cc1f8a40 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc165b40 con 0x7fa6b40040c0 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 0x7fa6cc162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 0x7fa6cc162e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45952/0 (socket says 172.21.15.78:45952) 2024-09-10T11:50:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 -- 172.21.15.78:0/2321660771 learned_addr learned my addr 172.21.15.78:0/2321660771 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6cb7fe640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6cc1f8a40 0x7fa6cc15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6cbfff640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6b40040c0 0x7fa6cc1f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 -- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6b40040c0 msgr2=0x7fa6cc1f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6b40040c0 0x7fa6cc1f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 -- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6cc1f8a40 msgr2=0x7fa6cc15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6cc1f8a40 0x7fa6cc15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 -- 172.21.15.78:0/2321660771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc1fb5e0 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d0db5640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 0x7fa6cc162e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc15ea50 tx=0x7fa6c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c401a070 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c400dd40 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc1fb8c0 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4004d90 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc1fbe80 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.819+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6cc1fc260 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.823+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa6c401d070 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.823+0000 7fa6c8ff9640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa6b806f740 0x7fa6b8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.823+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa6c408fc00 con 0x7fa6cc15bcf0 2024-09-10T11:50:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.823+0000 7fa6cbfff640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa6b806f740 0x7fa6b8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.823+0000 7fa6cbfff640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa6b806f740 0x7fa6b8071c00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001870 tx=0x7fa6bc000f80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:35.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:35.827+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fa6cc1fc260 con 0x7fa6cc15bcf0 2024-09-10T11:50:36.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6cc06ec40 con 0x7fa6cc15bcf0 2024-09-10T11:50:36.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6c8ff9640 1 -- 172.21.15.78:0/2321660771 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa6c405cb30 con 0x7fa6cc15bcf0 2024-09-10T11:50:36.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:36.016 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa6b806f740 msgr2=0x7fa6b8071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa6b806f740 0x7fa6b8071c00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001870 tx=0x7fa6bc000f80 comp rx=0 tx=0).stop 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 msgr2=0x7fa6cc162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 0x7fa6cc162e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc15ea50 tx=0x7fa6c400ec70 comp rx=0 tx=0).stop 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 shutdown_connections 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6cc1f8a40 0x7fa6cc15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa6b806f740 0x7fa6b8071c00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6cc15bcf0 0x7fa6cc162e90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 --2- 172.21.15.78:0/2321660771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6b40040c0 0x7fa6cc1f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 >> 172.21.15.78:0/2321660771 conn(0x7fa6cc0cf7c0 msgr2=0x7fa6cc15a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 shutdown_connections 2024-09-10T11:50:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:36.011+0000 7fa6d2818640 1 -- 172.21.15.78:0/2321660771 wait complete. 2024-09-10T11:50:39.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:39.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/2767683900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 msgr2=0x7efdb0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 --2- 172.21.15.78:0/2767683900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdb0004810 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efdc40b4dc0 tx=0x7efdc001cd80 comp rx=0 tx=0).stop 2024-09-10T11:50:39.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc9dc2640 1 -- 172.21.15.78:0/2767683900 reap_dead start 2024-09-10T11:50:39.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/2767683900 shutdown_connections 2024-09-10T11:50:39.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/2767683900 >> 172.21.15.78:0/2767683900 conn(0x7efdc40cf7c0 msgr2=0x7efdc40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:39.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/2767683900 shutdown_connections 2024-09-10T11:50:39.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/2767683900 wait complete. 2024-09-10T11:50:39.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 Processor -- start 2024-09-10T11:50:39.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- start start 2024-09-10T11:50:39.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdc406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc4159900 0x7efdc4159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc41f5480 0x7efdc41f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efdc41656d0 con 0x7efdb0004090 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4165550 con 0x7efdc41f5480 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efdc4165850 con 0x7efdc4159900 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdc406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdc406f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45978/0 (socket says 172.21.15.78:45978) 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 -- 172.21.15.78:0/3611740187 learned_addr learned my addr 172.21.15.78:0/3611740187 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc9dc2640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc41f5480 0x7efdc41f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc8dc0640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc4159900 0x7efdc4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 -- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc4159900 msgr2=0x7efdc4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc4159900 0x7efdc4159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 -- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc41f5480 msgr2=0x7efdc41f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc41f5480 0x7efdc41f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 -- 172.21.15.78:0/3611740187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc40ce1b0 con 0x7efdb0004090 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdc95c1640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdc406f170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efdb800e9f0 tx=0x7efdb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb800cc00 con 0x7efdb0004090 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdb800ce90 con 0x7efdb0004090 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc40ce490 con 0x7efdb0004090 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80116b0 con 0x7efdb0004090 2024-09-10T11:50:39.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc40cea50 con 0x7efdb0004090 2024-09-10T11:50:39.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.171+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc41f8f20 con 0x7efdb0004090 2024-09-10T11:50:39.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.175+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7efdb8011850 con 0x7efdb0004090 2024-09-10T11:50:39.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.175+0000 7efdb5ffb640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efda806f710 0x7efda8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.175+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7efdb8090410 con 0x7efdb0004090 2024-09-10T11:50:39.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.175+0000 7efdc8dc0640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efda806f710 0x7efda8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.175+0000 7efdc8dc0640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efda806f710 0x7efda8071bd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b0000 tx=0x7efdc0019b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:39.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.179+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7efdb8016030 con 0x7efdb0004090 2024-09-10T11:50:39.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efdc40b44a0 con 0x7efdb0004090 2024-09-10T11:50:39.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdb5ffb640 1 -- 172.21.15.78:0/3611740187 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7efdb805d330 con 0x7efdb0004090 2024-09-10T11:50:39.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:39.364 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efda806f710 msgr2=0x7efda8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efda806f710 0x7efda8071bd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b0000 tx=0x7efdc0019b20 comp rx=0 tx=0).stop 2024-09-10T11:50:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 msgr2=0x7efdc406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdc406f170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efdb800e9f0 tx=0x7efdb800eeb0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 shutdown_connections 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc41f5480 0x7efdc41f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7efda806f710 0x7efda8071bd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc4159900 0x7efdc4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 --2- 172.21.15.78:0/3611740187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb0004090 0x7efdc406f170 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 >> 172.21.15.78:0/3611740187 conn(0x7efdc40cf7c0 msgr2=0x7efdc40cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 shutdown_connections 2024-09-10T11:50:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:39.359+0000 7efdcb825640 1 -- 172.21.15.78:0/3611740187 wait complete. 2024-09-10T11:50:42.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:42.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/2444405503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f4c005220 msgr2=0x7f5f4c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/2444405503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f4c005220 0x7f5f4c00b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c006fd0 tx=0x7f5f5c01caf0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/2444405503 shutdown_connections 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/2444405503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f4c005220 0x7f5f4c00b9d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/2444405503 >> 172.21.15.78:0/2444405503 conn(0x7f5f640cf7c0 msgr2=0x7f5f640cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/2444405503 shutdown_connections 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/2444405503 wait complete. 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 Processor -- start 2024-09-10T11:50:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- start start 2024-09-10T11:50:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f4c005220 0x7f5f640adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f640731f0 0x7f5f64073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 0x7f5f641f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6415f7d0 con 0x7f5f641f6d10 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6415f650 con 0x7f5f640731f0 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6415f950 con 0x7f5f4c005220 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 0x7f5f641f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 0x7f5f641f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43008/0 (socket says 172.21.15.78:43008) 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 -- 172.21.15.78:0/3339781764 learned_addr learned my addr 172.21.15.78:0/3339781764 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f68c58640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f4c005220 0x7f5f640adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f63fff640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f640731f0 0x7f5f64073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 -- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f4c005220 msgr2=0x7f5f640adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f4c005220 0x7f5f640adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 -- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f640731f0 msgr2=0x7f5f64073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f640731f0 0x7f5f64073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 -- 172.21.15.78:0/3339781764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f641f76d0 con 0x7f5f641f6d10 2024-09-10T11:50:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f69459640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 0x7f5f641f7190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c01d390 tx=0x7f5f5c004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0062e0 con 0x7f5f641f6d10 2024-09-10T11:50:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5c0b5070 con 0x7f5f641f6d10 2024-09-10T11:50:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f64072010 con 0x7f5f641f6d10 2024-09-10T11:50:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0067f0 con 0x7f5f641f6d10 2024-09-10T11:50:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f640725b0 con 0x7f5f641f6d10 2024-09-10T11:50:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.515+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6415fb30 con 0x7f5f641f6d10 2024-09-10T11:50:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.519+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f5f5c0b1430 con 0x7f5f641f6d10 2024-09-10T11:50:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.519+0000 7f5f617fa640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5f5006f740 0x7f5f50071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.519+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5f5c12a710 con 0x7f5f641f6d10 2024-09-10T11:50:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.519+0000 7f5f68c58640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5f5006f740 0x7f5f50071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.519+0000 7f5f68c58640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5f5006f740 0x7f5f50071c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009b40 tx=0x7f5f540091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.523+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f5f5c016850 con 0x7f5f641f6d10 2024-09-10T11:50:42.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.695+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5f640b42a0 con 0x7f5f641f6d10 2024-09-10T11:50:42.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f617fa640 1 -- 172.21.15.78:0/3339781764 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f5f5c001ab0 con 0x7f5f641f6d10 2024-09-10T11:50:42.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:42.703 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:42.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5f5006f740 msgr2=0x7f5f50071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5f5006f740 0x7f5f50071c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009b40 tx=0x7f5f540091e0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 msgr2=0x7f5f641f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 0x7f5f641f7190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c01d390 tx=0x7f5f5c004fd0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 shutdown_connections 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f640731f0 0x7f5f64073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5f5006f740 0x7f5f50071c00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f641f6d10 0x7f5f641f7190 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 --2- 172.21.15.78:0/3339781764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f4c005220 0x7f5f640adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 >> 172.21.15.78:0/3339781764 conn(0x7f5f640cf7c0 msgr2=0x7f5f6415ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 shutdown_connections 2024-09-10T11:50:42.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:42.699+0000 7f5f6aebc640 1 -- 172.21.15.78:0/3339781764 wait complete. 2024-09-10T11:50:45.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:45.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 -- 172.21.15.78:0/2397815778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940cfb00 msgr2=0x7f1a940cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:45.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/2397815778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940cfb00 0x7f1a940cff40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009840 tx=0x7f1a8401c7e0 comp rx=0 tx=0).stop 2024-09-10T11:50:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 -- 172.21.15.78:0/2397815778 shutdown_connections 2024-09-10T11:50:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/2397815778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940cfb00 0x7f1a940cff40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/2397815778 >> v2:172.21.15.112:3300/0 conn(0x7f1a9415bcf0 0x7f1a940cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 -- 172.21.15.78:0/2397815778 >> 172.21.15.78:0/2397815778 conn(0x7f1a940d19f0 msgr2=0x7f1a940d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 -- 172.21.15.78:0/2397815778 shutdown_connections 2024-09-10T11:50:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.851+0000 7f1a9b51c640 1 -- 172.21.15.78:0/2397815778 wait complete. 2024-09-10T11:50:45.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 Processor -- start 2024-09-10T11:50:45.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- start start 2024-09-10T11:50:45.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 0x7f1a9414b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a940cfb00 0x7f1a940b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a940b61f0 0x7f1a9414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94168d00 con 0x7f1a940ce130 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94168b80 con 0x7f1a940cfb00 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1a94168e80 con 0x7f1a940b61f0 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 0x7f1a9414b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 0x7f1a9414b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43022/0 (socket says 172.21.15.78:43022) 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 -- 172.21.15.78:0/3871562500 learned_addr learned my addr 172.21.15.78:0/3871562500 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a98ab7640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a940cfb00 0x7f1a940b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a99ab9640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a940b61f0 0x7f1a9414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 -- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a940b61f0 msgr2=0x7f1a9414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a940b61f0 0x7f1a9414c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 -- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a940cfb00 msgr2=0x7f1a940b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a940cfb00 0x7f1a940b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 -- 172.21.15.78:0/3871562500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a94156fd0 con 0x7f1a940ce130 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a992b8640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 0x7f1a9414b540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c940 tx=0x7f1a9000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90004220 con 0x7f1a940ce130 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a900079b0 con 0x7f1a940ce130 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a941572b0 con 0x7f1a940ce130 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900044b0 con 0x7f1a940ce130 2024-09-10T11:50:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9414c080 con 0x7f1a940ce130 2024-09-10T11:50:45.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.855+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a940cff40 con 0x7f1a940ce130 2024-09-10T11:50:45.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.859+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1a90003600 con 0x7f1a940ce130 2024-09-10T11:50:45.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.859+0000 7f1a89ffb640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1a7806f710 0x7f1a78071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:45.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.859+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1a9008f9a0 con 0x7f1a940ce130 2024-09-10T11:50:45.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.859+0000 7f1a98ab7640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1a7806f710 0x7f1a78071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:45.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.859+0000 7f1a98ab7640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1a7806f710 0x7f1a78071bd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a840af000 tx=0x7f1a8401b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:45.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:45.863+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1a90014030 con 0x7f1a940ce130 2024-09-10T11:50:46.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.039+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1a9406a040 con 0x7f1a940ce130 2024-09-10T11:50:46.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.039+0000 7f1a89ffb640 1 -- 172.21.15.78:0/3871562500 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1a9005c8c0 con 0x7f1a940ce130 2024-09-10T11:50:46.045 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:46.045 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1a7806f710 msgr2=0x7f1a78071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1a7806f710 0x7f1a78071bd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a840af000 tx=0x7f1a8401b020 comp rx=0 tx=0).stop 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 msgr2=0x7f1a9414b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 0x7f1a9414b540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c940 tx=0x7f1a9000ce00 comp rx=0 tx=0).stop 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 shutdown_connections 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a940cfb00 0x7f1a940b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1a7806f710 0x7f1a78071bd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a940b61f0 0x7f1a9414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:46.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 --2- 172.21.15.78:0/3871562500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a940ce130 0x7f1a9414b540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:46.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 >> 172.21.15.78:0/3871562500 conn(0x7f1a940d19f0 msgr2=0x7f1a940c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:46.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 shutdown_connections 2024-09-10T11:50:46.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:46.043+0000 7f1a9b51c640 1 -- 172.21.15.78:0/3871562500 wait complete. 2024-09-10T11:50:49.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:49.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f290ca80640 1 -- 172.21.15.78:0/3114876989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28f4003a40 msgr2=0x7f28f4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:49.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f290ca80640 1 --2- 172.21.15.78:0/3114876989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28f4003a40 0x7f28f4003e60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f28f80013e0 tx=0x7f28f801d2c0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f2906d9d640 1 -- 172.21.15.78:0/3114876989 reap_dead start 2024-09-10T11:50:49.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f290ca80640 1 -- 172.21.15.78:0/3114876989 shutdown_connections 2024-09-10T11:50:49.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f290ca80640 1 -- 172.21.15.78:0/3114876989 >> 172.21.15.78:0/3114876989 conn(0x7f29080cf7c0 msgr2=0x7f29080cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:49.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f290ca80640 1 -- 172.21.15.78:0/3114876989 shutdown_connections 2024-09-10T11:50:49.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.191+0000 7f290ca80640 1 -- 172.21.15.78:0/3114876989 wait complete. 2024-09-10T11:50:49.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 Processor -- start 2024-09-10T11:50:49.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- start start 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f4003a40 0x7f29081f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 0x7f29081f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29080afba0 0x7f29081f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2908166710 con 0x7f29080af720 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2908166590 con 0x7f29080afba0 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2908166890 con 0x7f28f4003a40 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 0x7f29081f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 0x7f29081f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43050/0 (socket says 172.21.15.78:43050) 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 -- 172.21.15.78:0/473673534 learned_addr learned my addr 172.21.15.78:0/473673534 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:49.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2906d9d640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29080afba0 0x7f29081f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290659c640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f4003a40 0x7f29081f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 -- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f4003a40 msgr2=0x7f29081f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f4003a40 0x7f29081f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 -- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29080afba0 msgr2=0x7f29081f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29080afba0 0x7f29081f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 -- 172.21.15.78:0/473673534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29081f95a0 con 0x7f29080af720 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f2905d9b640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 0x7f29081f89e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f28f000fa00 tx=0x7f28f000fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f000bcb0 con 0x7f29080af720 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28f0004020 con 0x7f29080af720 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0004470 con 0x7f29080af720 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29081644e0 con 0x7f29080af720 2024-09-10T11:50:49.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2908164aa0 con 0x7f29080af720 2024-09-10T11:50:49.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.195+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290815c5a0 con 0x7f29080af720 2024-09-10T11:50:49.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.199+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f28f0019030 con 0x7f29080af720 2024-09-10T11:50:49.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.199+0000 7f28feffd640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28e806f710 0x7f28e8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:49.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.199+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f28f00901b0 con 0x7f29080af720 2024-09-10T11:50:49.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.199+0000 7f290659c640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28e806f710 0x7f28e8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:49.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.199+0000 7f290659c640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28e806f710 0x7f28e8071bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ac000 tx=0x7f28f801a100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:49.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.203+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f28f005cbf0 con 0x7f29080af720 2024-09-10T11:50:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2908157640 con 0x7f29080af720 2024-09-10T11:50:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f28feffd640 1 -- 172.21.15.78:0/473673534 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f28f00613b0 con 0x7f29080af720 2024-09-10T11:50:49.383 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:49.383 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28e806f710 msgr2=0x7f28e8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28e806f710 0x7f28e8071bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ac000 tx=0x7f28f801a100 comp rx=0 tx=0).stop 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 msgr2=0x7f29081f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 0x7f29081f89e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f28f000fa00 tx=0x7f28f000fec0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 shutdown_connections 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29080afba0 0x7f29081f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f28e806f710 0x7f28e8071bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29080af720 0x7f29081f89e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 --2- 172.21.15.78:0/473673534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f4003a40 0x7f29081f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:49.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 >> 172.21.15.78:0/473673534 conn(0x7f29080cf7c0 msgr2=0x7f29080b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:49.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 shutdown_connections 2024-09-10T11:50:49.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:49.379+0000 7f290ca80640 1 -- 172.21.15.78:0/473673534 wait complete. 2024-09-10T11:50:50.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:50:50.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:50:52.401 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:52.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 -- 172.21.15.78:0/1608658430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c161630 msgr2=0x7f1f6c0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 --2- 172.21.15.78:0/1608658430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c161630 0x7f1f6c0d0540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009900 tx=0x7f1f5c01c8b0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 -- 172.21.15.78:0/1608658430 shutdown_connections 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 --2- 172.21.15.78:0/1608658430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c161630 0x7f1f6c0d0540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 --2- 172.21.15.78:0/1608658430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f6c161250 0x7f1f6c0d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 -- 172.21.15.78:0/1608658430 >> 172.21.15.78:0/1608658430 conn(0x7f1f6c0d3c80 msgr2=0x7f1f6c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 -- 172.21.15.78:0/1608658430 shutdown_connections 2024-09-10T11:50:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.527+0000 7f1f72524640 1 -- 172.21.15.78:0/1608658430 wait complete. 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 Processor -- start 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- start start 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 0x7f1f6c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f6c161250 0x7f1f6c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c161630 0x7f1f6c0cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c16b290 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c16b110 con 0x7f1f6c161630 2024-09-10T11:50:52.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6c16b410 con 0x7f1f6c161250 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 0x7f1f6c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 0x7f1f6c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55278/0 (socket says 172.21.15.78:55278) 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 -- 172.21.15.78:0/1698006011 learned_addr learned my addr 172.21.15.78:0/1698006011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6b7fe640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f6c161250 0x7f1f6c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f70ac1640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c161630 0x7f1f6c0cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 -- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f6c161250 msgr2=0x7f1f6c0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f6c161250 0x7f1f6c0cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 -- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c161630 msgr2=0x7f1f6c0cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c161630 0x7f1f6c0cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 -- 172.21.15.78:0/1698006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c15b9d0 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f6bfff640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 0x7f1f6c15ca70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400d980 tx=0x7f1f5400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54017070 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f54009d60 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c15bcb0 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54005280 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c15c270 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.531+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c15cfb0 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.535+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1f54005420 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.535+0000 7f1f68ff9640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f4c06f710 0x7f1f4c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:52.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.535+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1f5408fe30 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.535+0000 7f1f6b7fe640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f4c06f710 0x7f1f4c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:52.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.535+0000 7f1f6b7fe640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f4c06f710 0x7f1f4c071bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0af000 tx=0x7f1f5c01b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:52.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.539+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1f6c15cfb0 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.707+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f6c06e7c0 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.707+0000 7f1f68ff9640 1 -- 172.21.15.78:0/1698006011 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1f5405ce30 con 0x7f1f6c0b4a10 2024-09-10T11:50:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:52.714 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f4c06f710 msgr2=0x7f1f4c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f4c06f710 0x7f1f4c071bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0af000 tx=0x7f1f5c01b0f0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 msgr2=0x7f1f6c15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 0x7f1f6c15ca70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400d980 tx=0x7f1f5400de40 comp rx=0 tx=0).stop 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 shutdown_connections 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c161630 0x7f1f6c0cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1f4c06f710 0x7f1f4c071bd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f6c161250 0x7f1f6c0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 --2- 172.21.15.78:0/1698006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f6c0b4a10 0x7f1f6c15ca70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 >> 172.21.15.78:0/1698006011 conn(0x7f1f6c0d3c80 msgr2=0x7f1f6c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 shutdown_connections 2024-09-10T11:50:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:52.711+0000 7f1f72524640 1 -- 172.21.15.78:0/1698006011 wait complete. 2024-09-10T11:50:55.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 -- 172.21.15.78:0/2810325103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c15bcf0 msgr2=0x7fbb3c0cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/2810325103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c15bcf0 0x7fbb3c0cf5c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009870 tx=0x7fbb3801c820 comp rx=0 tx=0).stop 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 -- 172.21.15.78:0/2810325103 shutdown_connections 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/2810325103 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb3c0cfb00 0x7fbb3c0cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/2810325103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c15bcf0 0x7fbb3c0cf5c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 -- 172.21.15.78:0/2810325103 >> 172.21.15.78:0/2810325103 conn(0x7fbb3c0d19f0 msgr2=0x7fbb3c0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 -- 172.21.15.78:0/2810325103 shutdown_connections 2024-09-10T11:50:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 -- 172.21.15.78:0/2810325103 wait complete. 2024-09-10T11:50:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.867+0000 7fbb43cd1640 1 Processor -- start 2024-09-10T11:50:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- start start 2024-09-10T11:50:55.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 0x7fbb3c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:55.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb3c0cfb00 0x7fbb3c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c150530 0x7fbb3c150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c168db0 con 0x7fbb3c0ce130 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c168c30 con 0x7fbb3c150530 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3c168f30 con 0x7fbb3c0cfb00 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 0x7fbb3c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 0x7fbb3c14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55296/0 (socket says 172.21.15.78:55296) 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 -- 172.21.15.78:0/3464849762 learned_addr learned my addr 172.21.15.78:0/3464849762 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb4126c640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb3c0cfb00 0x7fbb3c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb4226e640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c150530 0x7fbb3c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 -- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb3c0cfb00 msgr2=0x7fbb3c154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb3c0cfb00 0x7fbb3c154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 -- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c150530 msgr2=0x7fbb3c150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c150530 0x7fbb3c150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 -- 172.21.15.78:0/3464849762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c0cbe00 con 0x7fbb3c0ce130 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb41a6d640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 0x7fbb3c14e740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbb3801d0c0 tx=0x7fbb380a6740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380bd020 con 0x7fbb3c0ce130 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb38004430 con 0x7fbb3c0ce130 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c14ec80 con 0x7fbb3c0ce130 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38003840 con 0x7fbb3c0ce130 2024-09-10T11:50:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1f5a20 con 0x7fbb3c0ce130 2024-09-10T11:50:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3c0cff40 con 0x7fbb3c0ce130 2024-09-10T11:50:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.871+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fbb380c0020 con 0x7fbb3c0ce130 2024-09-10T11:50:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.875+0000 7fbb327fc640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbb2006f710 0x7fbb20071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.875+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fbb3812b320 con 0x7fbb3c0ce130 2024-09-10T11:50:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.875+0000 7fbb4126c640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbb2006f710 0x7fbb20071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.875+0000 7fbb4126c640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbb2006f710 0x7fbb20071bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005fd0 tx=0x7fbb2c005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:55.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:55.875+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fbb380c7030 con 0x7fbb3c0ce130 2024-09-10T11:50:56.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.059+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb3c159150 con 0x7fbb3c0ce130 2024-09-10T11:50:56.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.059+0000 7fbb327fc640 1 -- 172.21.15.78:0/3464849762 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fbb3c14ec80 con 0x7fbb3c0ce130 2024-09-10T11:50:56.065 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:56.065 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbb2006f710 msgr2=0x7fbb20071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbb2006f710 0x7fbb20071bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005fd0 tx=0x7fbb2c005860 comp rx=0 tx=0).stop 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 msgr2=0x7fbb3c14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 0x7fbb3c14e740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbb3801d0c0 tx=0x7fbb380a6740 comp rx=0 tx=0).stop 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 shutdown_connections 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c150530 0x7fbb3c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fbb2006f710 0x7fbb20071bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:56.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb3c0cfb00 0x7fbb3c154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:56.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 --2- 172.21.15.78:0/3464849762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb3c0ce130 0x7fbb3c14e740 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:56.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 >> 172.21.15.78:0/3464849762 conn(0x7fbb3c0d19f0 msgr2=0x7fbb3c0c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:56.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 shutdown_connections 2024-09-10T11:50:56.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:56.063+0000 7fbb43cd1640 1 -- 172.21.15.78:0/3464849762 wait complete. 2024-09-10T11:50:59.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/1303562841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8fc003a10 msgr2=0x7fb8fc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 --2- 172.21.15.78:0/1303562841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8fc003a10 0x7fb8fc003e30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009b90 tx=0x7fb90c01d270 comp rx=0 tx=0).stop 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916a42640 1 -- 172.21.15.78:0/1303562841 reap_dead start 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/1303562841 shutdown_connections 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/1303562841 >> 172.21.15.78:0/1303562841 conn(0x7fb9100cf7c0 msgr2=0x7fb9100cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/1303562841 shutdown_connections 2024-09-10T11:50:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/1303562841 wait complete. 2024-09-10T11:50:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 Processor -- start 2024-09-10T11:50:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- start start 2024-09-10T11:50:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 0x7fb9100ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb910072010 0x7fb9100ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9100b2d80 0x7fb9101f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb910166650 con 0x7fb9101f8100 2024-09-10T11:50:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101664d0 con 0x7fb910072010 2024-09-10T11:50:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb9101667d0 con 0x7fb9100b2d80 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 0x7fb9100ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 0x7fb9100ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55318/0 (socket says 172.21.15.78:55318) 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 -- 172.21.15.78:0/351369840 learned_addr learned my addr 172.21.15.78:0/351369840 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb915a40640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb910072010 0x7fb9100ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916a42640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9100b2d80 0x7fb9101f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 -- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9100b2d80 msgr2=0x7fb9101f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9100b2d80 0x7fb9101f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 -- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb910072010 msgr2=0x7fb9100ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb910072010 0x7fb9100ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 -- 172.21.15.78:0/351369840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100724a0 con 0x7fb9101f8100 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916a42640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9100b2d80 0x7fb9101f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb916241640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 0x7fb9100ad8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009b90 tx=0x7fb90c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0b1040 con 0x7fb9101f8100 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb90c0bb070 con 0x7fb9101f8100 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb910072780 con 0x7fb9101f8100 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004290 con 0x7fb9101f8100 2024-09-10T11:50:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.215+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb910072d40 con 0x7fb9101f8100 2024-09-10T11:50:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.219+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9100cdf10 con 0x7fb9101f8100 2024-09-10T11:50:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.219+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb90c0046d0 con 0x7fb9101f8100 2024-09-10T11:50:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.219+0000 7fb906ffd640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb8f406f740 0x7fb8f4071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.219+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb90c12a790 con 0x7fb9101f8100 2024-09-10T11:50:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.219+0000 7fb915a40640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb8f406f740 0x7fb8f4071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.219+0000 7fb915a40640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb8f406f740 0x7fb8f4071c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9101656c0 tx=0x7fb900001bf0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.223+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb90c016fc0 con 0x7fb9101f8100 2024-09-10T11:50:59.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.399+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb91015c450 con 0x7fb9101f8100 2024-09-10T11:50:59.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.399+0000 7fb906ffd640 1 -- 172.21.15.78:0/351369840 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb90c0f76b0 con 0x7fb9101f8100 2024-09-10T11:50:59.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:50:59.405 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:50:59.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb8f406f740 msgr2=0x7fb8f4071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:59.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb8f406f740 0x7fb8f4071c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9101656c0 tx=0x7fb900001bf0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 msgr2=0x7fb9100ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:59.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 0x7fb9100ad8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009b90 tx=0x7fb90c005590 comp rx=0 tx=0).stop 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 shutdown_connections 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb910072010 0x7fb9100ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb8f406f740 0x7fb8f4071c00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9100b2d80 0x7fb9101f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 --2- 172.21.15.78:0/351369840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9101f8100 0x7fb9100ad8d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 >> 172.21.15.78:0/351369840 conn(0x7fb9100cf7c0 msgr2=0x7fb91015d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 shutdown_connections 2024-09-10T11:50:59.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:50:59.403+0000 7fb9184a5640 1 -- 172.21.15.78:0/351369840 wait complete. 2024-09-10T11:51:02.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:02.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.551+0000 7fe1990a5640 1 -- 172.21.15.78:0/3446064609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 msgr2=0x7fe19415f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.551+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3446064609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe19415f650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe184009840 tx=0x7fe18401f010 comp rx=0 tx=0).stop 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- 172.21.15.78:0/3446064609 shutdown_connections 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3446064609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe19406ded0 0x7fe19406e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3446064609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe19415f650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- 172.21.15.78:0/3446064609 >> 172.21.15.78:0/3446064609 conn(0x7fe1940cf7c0 msgr2=0x7fe1940cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- 172.21.15.78:0/3446064609 shutdown_connections 2024-09-10T11:51:02.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- 172.21.15.78:0/3446064609 wait complete. 2024-09-10T11:51:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 Processor -- start 2024-09-10T11:51:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- start start 2024-09-10T11:51:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe19406ded0 0x7fe1941e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe19415bc80 0x7fe1941f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe1941514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1940cecc0 con 0x7fe19415f270 2024-09-10T11:51:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1940ceb40 con 0x7fe19415bc80 2024-09-10T11:51:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe1940cee40 con 0x7fe19406ded0 2024-09-10T11:51:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe1941514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe1941514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37096/0 (socket says 172.21.15.78:37096) 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 -- 172.21.15.78:0/3601621195 learned_addr learned my addr 172.21.15.78:0/3601621195 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe192d9d640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe19406ded0 0x7fe1941e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19259c640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe19415bc80 0x7fe1941f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 -- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe19406ded0 msgr2=0x7fe1941e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe19406ded0 0x7fe1941e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 -- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe19415bc80 msgr2=0x7fe1941f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe19415bc80 0x7fe1941f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 -- 172.21.15.78:0/3601621195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe194152610 con 0x7fe19415f270 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe19359e640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe1941514f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c730 tx=0x7fe18c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003db0 con 0x7fe19415f270 2024-09-10T11:51:02.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c00ce40 con 0x7fe19415f270 2024-09-10T11:51:02.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1941f78c0 con 0x7fe19415f270 2024-09-10T11:51:02.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0052d0 con 0x7fe19415f270 2024-09-10T11:51:02.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.555+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe194073ae0 con 0x7fe19415f270 2024-09-10T11:51:02.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.559+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19415c9e0 con 0x7fe19415f270 2024-09-10T11:51:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.559+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fe18c005470 con 0x7fe19415f270 2024-09-10T11:51:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.559+0000 7fe17b7fe640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe18006f710 0x7fe180071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.559+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe18c08f600 con 0x7fe19415f270 2024-09-10T11:51:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.559+0000 7fe192d9d640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe18006f710 0x7fe180071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.559+0000 7fe192d9d640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe18006f710 0x7fe180071bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b2000 tx=0x7fe18401d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.563+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fe194152610 con 0x7fe19415f270 2024-09-10T11:51:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.739+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe19415c3e0 con 0x7fe19415f270 2024-09-10T11:51:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.739+0000 7fe17b7fe640 1 -- 172.21.15.78:0/3601621195 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fe19415c3e0 con 0x7fe19415f270 2024-09-10T11:51:02.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:02.747 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe18006f710 msgr2=0x7fe180071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe18006f710 0x7fe180071bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b2000 tx=0x7fe18401d850 comp rx=0 tx=0).stop 2024-09-10T11:51:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 msgr2=0x7fe1941514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe1941514f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c730 tx=0x7fe18c00cbf0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 shutdown_connections 2024-09-10T11:51:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe19415bc80 0x7fe1941f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe18006f710 0x7fe180071bd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe19415f270 0x7fe1941514f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 --2- 172.21.15.78:0/3601621195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe19406ded0 0x7fe1941e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 >> 172.21.15.78:0/3601621195 conn(0x7fe1940cf7c0 msgr2=0x7fe19415cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 shutdown_connections 2024-09-10T11:51:02.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:02.743+0000 7fe1990a5640 1 -- 172.21.15.78:0/3601621195 wait complete. 2024-09-10T11:51:05.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:05.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/492243575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc0b4a10 msgr2=0x7fb9fc0b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:05.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 --2- 172.21.15.78:0/492243575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0b33a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc08e370 tx=0x7fb9f401cd50 comp rx=0 tx=0).stop 2024-09-10T11:51:05.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/492243575 shutdown_connections 2024-09-10T11:51:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 --2- 172.21.15.78:0/492243575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0b33a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 --2- 172.21.15.78:0/492243575 >> v2:172.21.15.112:3300/0 conn(0x7fb9fc161630 0x7fb9fc0d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/492243575 >> 172.21.15.78:0/492243575 conn(0x7fb9fc0d3c80 msgr2=0x7fb9fc0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/492243575 shutdown_connections 2024-09-10T11:51:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/492243575 wait complete. 2024-09-10T11:51:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 Processor -- start 2024-09-10T11:51:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- start start 2024-09-10T11:51:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc161250 0x7fb9fc153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 0x7fb9fc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc16acc0 con 0x7fb9fc161630 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc16ab40 con 0x7fb9fc0b4a10 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc16ae40 con 0x7fb9fc161250 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 0x7fb9fc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 0x7fb9fc1595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37114/0 (socket says 172.21.15.78:37114) 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 -- 172.21.15.78:0/613884205 learned_addr learned my addr 172.21.15.78:0/613884205 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02101640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba01900640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc161250 0x7fb9fc153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 -- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc161250 msgr2=0x7fb9fc153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc161250 0x7fb9fc153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 -- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc0b4a10 msgr2=0x7fb9fc0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 -- 172.21.15.78:0/613884205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc0b94a0 con 0x7fb9fc161630 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02101640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba01900640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc161250 0x7fb9fc153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba02902640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 0x7fb9fc1595d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4019960 tx=0x7fb9f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40bb070 con 0x7fb9fc161630 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9f4004b40 con 0x7fb9fc161630 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc15b7b0 con 0x7fb9fc161630 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40b2040 con 0x7fb9fc161630 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.899+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc15bd70 con 0x7fb9fc161630 2024-09-10T11:51:05.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.903+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc0b33a0 con 0x7fb9fc161630 2024-09-10T11:51:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.903+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb9f40be070 con 0x7fb9fc161630 2024-09-10T11:51:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.903+0000 7fb9f2ffd640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.903+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb9f41296b0 con 0x7fb9fc161630 2024-09-10T11:51:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.903+0000 7fba02101640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.903+0000 7fba02101640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8000f70 tx=0x7fb9f8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:05.907+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb9f4016970 con 0x7fb9fc161630 2024-09-10T11:51:06.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.087+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9fc154690 con 0x7fb9fc161630 2024-09-10T11:51:06.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.087+0000 7fb9f2ffd640 1 -- 172.21.15.78:0/613884205 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb9f40f65d0 con 0x7fb9fc161630 2024-09-10T11:51:06.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:06.094 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 msgr2=0x7fb9e0071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8000f70 tx=0x7fb9f8009040 comp rx=0 tx=0).stop 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 msgr2=0x7fb9fc1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 0x7fb9fc1595d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4019960 tx=0x7fb9f4004270 comp rx=0 tx=0).stop 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 shutdown_connections 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb9e006f710 0x7fb9e0071bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9fc161630 0x7fb9fc1595d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc161250 0x7fb9fc153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 --2- 172.21.15.78:0/613884205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc0b4a10 0x7fb9fc0cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 >> 172.21.15.78:0/613884205 conn(0x7fb9fc0d3c80 msgr2=0x7fb9fc15a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 shutdown_connections 2024-09-10T11:51:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:06.091+0000 7fba04365640 1 -- 172.21.15.78:0/613884205 wait complete. 2024-09-10T11:51:09.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb8468aa640 1 -- 172.21.15.78:0/341805868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb828004810 msgr2=0x7fb828004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb8468aa640 1 --2- 172.21.15.78:0/341805868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb828004810 0x7fb828004c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb834009b60 tx=0x7fb83401d2b0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb844e47640 1 -- 172.21.15.78:0/341805868 reap_dead start 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb8468aa640 1 -- 172.21.15.78:0/341805868 shutdown_connections 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb8468aa640 1 -- 172.21.15.78:0/341805868 >> 172.21.15.78:0/341805868 conn(0x7fb8400cf7c0 msgr2=0x7fb8400cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb8468aa640 1 -- 172.21.15.78:0/341805868 shutdown_connections 2024-09-10T11:51:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.243+0000 7fb8468aa640 1 -- 172.21.15.78:0/341805868 wait complete. 2024-09-10T11:51:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 Processor -- start 2024-09-10T11:51:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- start start 2024-09-10T11:51:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb828004810 0x7fb84014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb84014bf60 0x7fb8400ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 0x7fb8400ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb84006e760 con 0x7fb840073cb0 2024-09-10T11:51:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb84006e5e0 con 0x7fb84014bf60 2024-09-10T11:51:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb84006e8e0 con 0x7fb828004810 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 0x7fb8400ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 0x7fb8400ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37126/0 (socket says 172.21.15.78:37126) 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 -- 172.21.15.78:0/992652361 learned_addr learned my addr 172.21.15.78:0/992652361 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb83ffff640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb828004810 0x7fb84014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb83f7fe640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb84014bf60 0x7fb8400ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 -- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb828004810 msgr2=0x7fb84014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb828004810 0x7fb84014b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 -- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb84014bf60 msgr2=0x7fb8400ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb84014bf60 0x7fb8400ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 -- 172.21.15.78:0/992652361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84014bd70 con 0x7fb840073cb0 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb83ffff640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb828004810 0x7fb84014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb844e47640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 0x7fb8400ade40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb83800cc20 tx=0x7fb83800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838017070 con 0x7fb840073cb0 2024-09-10T11:51:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb83800aae0 con 0x7fb840073cb0 2024-09-10T11:51:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8401f78b0 con 0x7fb840073cb0 2024-09-10T11:51:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380070d0 con 0x7fb840073cb0 2024-09-10T11:51:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8401f7b50 con 0x7fb840073cb0 2024-09-10T11:51:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.247+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8400af2e0 con 0x7fb840073cb0 2024-09-10T11:51:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.251+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb83801a070 con 0x7fb840073cb0 2024-09-10T11:51:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.251+0000 7fb83cff9640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb82c06f740 0x7fb82c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.251+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb83808f0b0 con 0x7fb840073cb0 2024-09-10T11:51:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.251+0000 7fb83ffff640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb82c06f740 0x7fb82c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.251+0000 7fb83ffff640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb82c06f740 0x7fb82c071c00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb84015b040 tx=0x7fb830006c00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:09.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.255+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb8400af2e0 con 0x7fb840073cb0 2024-09-10T11:51:09.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.431+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb840150300 con 0x7fb840073cb0 2024-09-10T11:51:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.431+0000 7fb83cff9640 1 -- 172.21.15.78:0/992652361 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb83805c120 con 0x7fb840073cb0 2024-09-10T11:51:09.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:09.436 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb82c06f740 msgr2=0x7fb82c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb82c06f740 0x7fb82c071c00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb84015b040 tx=0x7fb830006c00 comp rx=0 tx=0).stop 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 msgr2=0x7fb8400ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 0x7fb8400ade40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb83800cc20 tx=0x7fb83800cd10 comp rx=0 tx=0).stop 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 shutdown_connections 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb84014bf60 0x7fb8400ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb82c06f740 0x7fb82c071c00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb840073cb0 0x7fb8400ade40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 --2- 172.21.15.78:0/992652361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb828004810 0x7fb84014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 >> 172.21.15.78:0/992652361 conn(0x7fb8400cf7c0 msgr2=0x7fb84015ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 shutdown_connections 2024-09-10T11:51:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:09.435+0000 7fb8468aa640 1 -- 172.21.15.78:0/992652361 wait complete. 2024-09-10T11:51:12.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/1437410456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806fdb0 msgr2=0x7f851815c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 --2- 172.21.15.78:0/1437410456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806fdb0 0x7f851815c5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f85180b4f70 tx=0x7f851001cb50 comp rx=0 tx=0).stop 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/1437410456 shutdown_connections 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 --2- 172.21.15.78:0/1437410456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806fdb0 0x7f851815c5a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 --2- 172.21.15.78:0/1437410456 >> v2:172.21.15.112:3300/0 conn(0x7f85180732d0 0x7f851806f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/1437410456 >> 172.21.15.78:0/1437410456 conn(0x7f85180cf7c0 msgr2=0x7f85180cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/1437410456 shutdown_connections 2024-09-10T11:51:12.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/1437410456 wait complete. 2024-09-10T11:51:12.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 Processor -- start 2024-09-10T11:51:12.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- start start 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f851806fdb0 0x7f851814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 0x7f85180cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f851815a580 0x7f85181422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8518167380 con 0x7f85180732d0 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8518167500 con 0x7f851806fdb0 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8518167680 con 0x7f851815a580 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 0x7f85180cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 0x7f85180cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42560/0 (socket says 172.21.15.78:42560) 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 -- 172.21.15.78:0/3446608063 learned_addr learned my addr 172.21.15.78:0/3446608063 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 -- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f851815a580 msgr2=0x7f85181422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f851815a580 0x7f85181422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 -- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f851806fdb0 msgr2=0x7f851814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f8516ffd640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f851806fdb0 0x7f851814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f851806fdb0 0x7f851814ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 -- 172.21.15.78:0/3446608063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8518142820 con 0x7f85180732d0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f850e7fc640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 0x7f85180cd740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f850000c930 tx=0x7f850000cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500007c70 con 0x7f85180732d0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f850000f450 con 0x7f85180732d0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85181fa960 con 0x7f85180732d0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850000f8a0 con 0x7f85180732d0 2024-09-10T11:51:12.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.587+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85181faf20 con 0x7f85180732d0 2024-09-10T11:51:12.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.591+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85180ae5f0 con 0x7f85180732d0 2024-09-10T11:51:12.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.591+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f850000fa40 con 0x7f85180732d0 2024-09-10T11:51:12.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.591+0000 7f8514ff9640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84f806f710 0x7f84f8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:12.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.591+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f85000900c0 con 0x7f85180732d0 2024-09-10T11:51:12.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.591+0000 7f8516ffd640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84f806f710 0x7f84f8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:12.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.591+0000 7f8516ffd640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84f806f710 0x7f84f8071bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8508000f70 tx=0x7f8508009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:12.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.595+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f8500014030 con 0x7f85180732d0 2024-09-10T11:51:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.771+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f85180b3600 con 0x7f85180732d0 2024-09-10T11:51:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f8514ff9640 1 -- 172.21.15.78:0/3446608063 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f850005cfd0 con 0x7f85180732d0 2024-09-10T11:51:12.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:12.779 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84f806f710 msgr2=0x7f84f8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84f806f710 0x7f84f8071bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8508000f70 tx=0x7f8508009040 comp rx=0 tx=0).stop 2024-09-10T11:51:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 msgr2=0x7f85180cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 0x7f85180cd740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f850000c930 tx=0x7f850000cdf0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 shutdown_connections 2024-09-10T11:51:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f84f806f710 0x7f84f8071bd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f851815a580 0x7f85181422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85180732d0 0x7f85180cd740 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 --2- 172.21.15.78:0/3446608063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f851806fdb0 0x7f851814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 >> 172.21.15.78:0/3446608063 conn(0x7f85180cf7c0 msgr2=0x7f85181594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 shutdown_connections 2024-09-10T11:51:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:12.775+0000 7f851d9b8640 1 -- 172.21.15.78:0/3446608063 wait complete. 2024-09-10T11:51:15.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2434175167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c15bcf0 msgr2=0x7fcd6c0cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2434175167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c15bcf0 0x7fcd6c0cf5c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009840 tx=0x7fcd5c01c7e0 comp rx=0 tx=0).stop 2024-09-10T11:51:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2434175167 shutdown_connections 2024-09-10T11:51:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2434175167 >> v2:172.21.15.112:3300/0 conn(0x7fcd6c071900 0x7fcd6c0cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2434175167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c15bcf0 0x7fcd6c0cf5c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2434175167 >> 172.21.15.78:0/2434175167 conn(0x7fcd6c0d19f0 msgr2=0x7fcd6c0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2434175167 shutdown_connections 2024-09-10T11:51:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.923+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2434175167 wait complete. 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 Processor -- start 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- start start 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c071900 0x7fcd6c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd6c0cfb00 0x7fcd6c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 0x7fcd6c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1688b0 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c0cf350 con 0x7fcd6c071900 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6c168a30 con 0x7fcd6c0cfb00 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 0x7fcd6c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 0x7fcd6c15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42578/0 (socket says 172.21.15.78:42578) 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 -- 172.21.15.78:0/2781724122 learned_addr learned my addr 172.21.15.78:0/2781724122 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd70c5f640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c071900 0x7fcd6c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd6bfff640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd6c0cfb00 0x7fcd6c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 -- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd6c0cfb00 msgr2=0x7fcd6c14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd6c0cfb00 0x7fcd6c14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 -- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c071900 msgr2=0x7fcd6c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c071900 0x7fcd6c14db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 -- 172.21.15.78:0/2781724122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c15deb0 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd71460640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 0x7fcd6c15caf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400b9e0 tx=0x7fcd6400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64019070 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd6400cc10 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd640146a0 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c15e190 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c15db80 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.927+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c0cff40 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.931+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fcd6401c070 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.931+0000 7fcd697fa640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcd5806f710 0x7fcd58071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.931+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fcd6408f4f0 con 0x7fcd6c14f1b0 2024-09-10T11:51:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.931+0000 7fcd70c5f640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcd5806f710 0x7fcd58071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.931+0000 7fcd70c5f640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcd5806f710 0x7fcd58071bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0af000 tx=0x7fcd5c01b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:15.935+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fcd6405c4a0 con 0x7fcd6c14f1b0 2024-09-10T11:51:16.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.115+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd6c0b0950 con 0x7fcd6c14f1b0 2024-09-10T11:51:16.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.115+0000 7fcd697fa640 1 -- 172.21.15.78:0/2781724122 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fcd6408de20 con 0x7fcd6c14f1b0 2024-09-10T11:51:16.122 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:16.122 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:16.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcd5806f710 msgr2=0x7fcd58071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:16.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcd5806f710 0x7fcd58071bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0af000 tx=0x7fcd5c01b020 comp rx=0 tx=0).stop 2024-09-10T11:51:16.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 msgr2=0x7fcd6c15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:16.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 0x7fcd6c15caf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400b9e0 tx=0x7fcd6400bea0 comp rx=0 tx=0).stop 2024-09-10T11:51:16.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 shutdown_connections 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcd5806f710 0x7fcd58071bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd6c14f1b0 0x7fcd6c15caf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd6c0cfb00 0x7fcd6c14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 --2- 172.21.15.78:0/2781724122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c071900 0x7fcd6c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 >> 172.21.15.78:0/2781724122 conn(0x7fcd6c0d19f0 msgr2=0x7fcd6c0c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 shutdown_connections 2024-09-10T11:51:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:16.119+0000 7fcd72ec3640 1 -- 172.21.15.78:0/2781724122 wait complete. 2024-09-10T11:51:19.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:19.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 -- 172.21.15.78:0/2287899253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b01528c0 msgr2=0x7f65b00b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/2287899253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b01528c0 0x7f65b00b4f70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009900 tx=0x7f65a001c640 comp rx=0 tx=0).stop 2024-09-10T11:51:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 -- 172.21.15.78:0/2287899253 shutdown_connections 2024-09-10T11:51:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/2287899253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b01528c0 0x7f65b00b4f70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 -- 172.21.15.78:0/2287899253 >> 172.21.15.78:0/2287899253 conn(0x7f65b00cf7c0 msgr2=0x7f65b00cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 -- 172.21.15.78:0/2287899253 shutdown_connections 2024-09-10T11:51:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.271+0000 7f65b5c2e640 1 -- 172.21.15.78:0/2287899253 wait complete. 2024-09-10T11:51:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 Processor -- start 2024-09-10T11:51:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- start start 2024-09-10T11:51:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65b006e8f0 0x7f65b00b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 0x7f65b00b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65b01528c0 0x7f65b00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0169880 con 0x7f65b00b54b0 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0169700 con 0x7f65b006e8f0 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f65b0169a00 con 0x7f65b01528c0 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 0x7f65b00b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 0x7f65b00b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42608/0 (socket says 172.21.15.78:42608) 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 -- 172.21.15.78:0/1983423611 learned_addr learned my addr 172.21.15.78:0/1983423611 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65af7fe640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65b006e8f0 0x7f65b00b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65affff640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65b01528c0 0x7f65b00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 -- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65b01528c0 msgr2=0x7f65b00b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65b01528c0 0x7f65b00b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 -- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65b006e8f0 msgr2=0x7f65b00b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65b006e8f0 0x7f65b00b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 -- 172.21.15.78:0/1983423611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0131df0 con 0x7f65b00b54b0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65affff640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65b01528c0 0x7f65b00b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65aeffd640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 0x7f65b00b1280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c450 tx=0x7f65a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4012830 con 0x7f65b00b54b0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65a4017070 con 0x7f65b00b54b0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00b0d70 con 0x7f65b00b54b0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4012d80 con 0x7f65b00b54b0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b0152f20 con 0x7f65b00b54b0 2024-09-10T11:51:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b00b4f70 con 0x7f65b00b54b0 2024-09-10T11:51:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.275+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f65a401c460 con 0x7f65b00b54b0 2024-09-10T11:51:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.279+0000 7f6597fff640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f659c06f710 0x7f659c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.279+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f65a408f680 con 0x7f65b00b54b0 2024-09-10T11:51:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.279+0000 7f65af7fe640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f659c06f710 0x7f659c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:19.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.279+0000 7f65af7fe640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f659c06f710 0x7f659c071bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f65a00af000 tx=0x7f65a001ae80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:19.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.283+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f65a405c5b0 con 0x7f65b00b54b0 2024-09-10T11:51:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.455+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65b00b0fa0 con 0x7f65b00b54b0 2024-09-10T11:51:19.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.455+0000 7f6597fff640 1 -- 172.21.15.78:0/1983423611 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f65a405beb0 con 0x7f65b00b54b0 2024-09-10T11:51:19.462 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:19.462 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f659c06f710 msgr2=0x7f659c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f659c06f710 0x7f659c071bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f65a00af000 tx=0x7f65a001ae80 comp rx=0 tx=0).stop 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 msgr2=0x7f65b00b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 0x7f65b00b1280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c450 tx=0x7f65a400c910 comp rx=0 tx=0).stop 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 shutdown_connections 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f659c06f710 0x7f659c071bd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65b01528c0 0x7f65b00b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65b00b54b0 0x7f65b00b1280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 --2- 172.21.15.78:0/1983423611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65b006e8f0 0x7f65b00b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 >> 172.21.15.78:0/1983423611 conn(0x7f65b00cf7c0 msgr2=0x7f65b0166cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 shutdown_connections 2024-09-10T11:51:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:19.459+0000 7f65b5c2e640 1 -- 172.21.15.78:0/1983423611 wait complete. 2024-09-10T11:51:20.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:51:20.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:51:22.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 -- 172.21.15.78:0/1069168666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 msgr2=0x7f48d806e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 --2- 172.21.15.78:0/1069168666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d806e1e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48d815bd60 tx=0x7f48d401c620 comp rx=0 tx=0).stop 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 -- 172.21.15.78:0/1069168666 shutdown_connections 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 --2- 172.21.15.78:0/1069168666 >> v2:172.21.15.112:3300/0 conn(0x7f48d806e720 0x7f48d80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 --2- 172.21.15.78:0/1069168666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d806e1e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 -- 172.21.15.78:0/1069168666 >> 172.21.15.78:0/1069168666 conn(0x7f48d80cf7c0 msgr2=0x7f48d80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 -- 172.21.15.78:0/1069168666 shutdown_connections 2024-09-10T11:51:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.611+0000 7f48dfce7640 1 -- 172.21.15.78:0/1069168666 wait complete. 2024-09-10T11:51:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 Processor -- start 2024-09-10T11:51:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- start start 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d806e720 0x7f48d813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d81528c0 0x7f48d81587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81686f0 con 0x7f48d80b5680 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80cf180 con 0x7f48d806e720 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f48d8168870 con 0x7f48d81528c0 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d8158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48064/0 (socket says 172.21.15.78:48064) 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 -- 172.21.15.78:0/3860554221 learned_addr learned my addr 172.21.15.78:0/3860554221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 -- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d81528c0 msgr2=0x7f48d81587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d81528c0 0x7f48d81587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 -- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d806e720 msgr2=0x7f48d813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d806e720 0x7f48d813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 -- 172.21.15.78:0/3860554221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d80b2c10 con 0x7f48d80b5680 2024-09-10T11:51:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dd282640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d8158260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f48d40b0040 tx=0x7f48d40a66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:22.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4004380 con 0x7f48d80b5680 2024-09-10T11:51:22.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48d4005030 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d80b2ef0 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4005480 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d80b34b0 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d80cdea0 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.615+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f48d40a6820 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.619+0000 7f48ce7fc640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f48bc06f770 0x7f48bc071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.619+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f48d4129a80 con 0x7f48d80b5680 2024-09-10T11:51:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.619+0000 7f48dda83640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f48bc06f770 0x7f48bc071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.619+0000 7f48dda83640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f48bc06f770 0x7f48bc071c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009670 tx=0x7f48c8006bd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:22.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.623+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f48d40bf060 con 0x7f48d80b5680 2024-09-10T11:51:22.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.799+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f48d815d130 con 0x7f48d80b5680 2024-09-10T11:51:22.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.799+0000 7f48ce7fc640 1 -- 172.21.15.78:0/3860554221 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f48d8152ca0 con 0x7f48d80b5680 2024-09-10T11:51:22.805 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:22.805 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f48bc06f770 msgr2=0x7f48bc071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f48bc06f770 0x7f48bc071c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009670 tx=0x7f48c8006bd0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 msgr2=0x7f48d8158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d8158260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f48d40b0040 tx=0x7f48d40a66b0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 shutdown_connections 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f48bc06f770 0x7f48bc071c30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d81528c0 0x7f48d81587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d80b5680 0x7f48d8158260 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 --2- 172.21.15.78:0/3860554221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d806e720 0x7f48d813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 >> 172.21.15.78:0/3860554221 conn(0x7f48d80cf7c0 msgr2=0x7f48d815d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 shutdown_connections 2024-09-10T11:51:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:22.803+0000 7f48dfce7640 1 -- 172.21.15.78:0/3860554221 wait complete. 2024-09-10T11:51:25.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:25.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 -- 172.21.15.78:0/4199275576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90340b54b0 msgr2=0x7f903406e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:25.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 --2- 172.21.15.78:0/4199275576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90340b54b0 0x7f903406e250 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9034071180 tx=0x7f903001c5d0 comp rx=0 tx=0).stop 2024-09-10T11:51:25.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 -- 172.21.15.78:0/4199275576 shutdown_connections 2024-09-10T11:51:25.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 --2- 172.21.15.78:0/4199275576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f903406e790 0x7f903415f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:25.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 --2- 172.21.15.78:0/4199275576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90340b54b0 0x7f903406e250 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 --2- 172.21.15.78:0/4199275576 >> v2:172.21.15.112:3300/0 conn(0x7f9034152830 0x7f90340b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 -- 172.21.15.78:0/4199275576 >> 172.21.15.78:0/4199275576 conn(0x7f90340cf7c0 msgr2=0x7f90340cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 -- 172.21.15.78:0/4199275576 shutdown_connections 2024-09-10T11:51:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.951+0000 7f903bc71640 1 -- 172.21.15.78:0/4199275576 wait complete. 2024-09-10T11:51:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 Processor -- start 2024-09-10T11:51:25.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- start start 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f903406e790 0x7f9034155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90340b54b0 0x7f903415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 0x7f903415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90340ce540 con 0x7f9034152830 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90340ce3c0 con 0x7f903406e790 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f90340ce6c0 con 0x7f90340b54b0 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 0x7f903415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 0x7f903415e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48080/0 (socket says 172.21.15.78:48080) 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 -- 172.21.15.78:0/2791678244 learned_addr learned my addr 172.21.15.78:0/2791678244 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f9039a0d640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f903406e790 0x7f9034155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903920c640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90340b54b0 0x7f903415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:25.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 -- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90340b54b0 msgr2=0x7f903415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90340b54b0 0x7f903415dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 -- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f903406e790 msgr2=0x7f9034155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f903406e790 0x7f9034155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 -- 172.21.15.78:0/2791678244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9034156760 con 0x7f9034152830 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f9039a0d640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f903406e790 0x7f9034155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903a20e640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 0x7f903415e000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f902c00ca60 tx=0x7f902c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c00adc0 con 0x7f9034152830 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f902c004c40 con 0x7f9034152830 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9034156a40 con 0x7f9034152830 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c005280 con 0x7f9034152830 2024-09-10T11:51:25.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903414e030 con 0x7f9034152830 2024-09-10T11:51:25.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.955+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9034156e30 con 0x7f9034152830 2024-09-10T11:51:25.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.959+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f902c005420 con 0x7f9034152830 2024-09-10T11:51:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.959+0000 7f902a7fc640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f901806f710 0x7f9018071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.959+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f902c08ffc0 con 0x7f9034152830 2024-09-10T11:51:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.959+0000 7f9039a0d640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f901806f710 0x7f9018071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.959+0000 7f9039a0d640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f901806f710 0x7f9018071bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9024005fd0 tx=0x7f9024005d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:25.963+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f902c014030 con 0x7f9034152830 2024-09-10T11:51:26.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f903415c820 con 0x7f9034152830 2024-09-10T11:51:26.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f902a7fc640 1 -- 172.21.15.78:0/2791678244 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f902c05cf70 con 0x7f9034152830 2024-09-10T11:51:26.147 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:26.147 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:26.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f901806f710 msgr2=0x7f9018071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:26.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f901806f710 0x7f9018071bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9024005fd0 tx=0x7f9024005d00 comp rx=0 tx=0).stop 2024-09-10T11:51:26.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 msgr2=0x7f903415e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:26.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 0x7f903415e000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f902c00ca60 tx=0x7f902c00cf20 comp rx=0 tx=0).stop 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 shutdown_connections 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f901806f710 0x7f9018071bd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9034152830 0x7f903415e000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90340b54b0 0x7f903415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 --2- 172.21.15.78:0/2791678244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f903406e790 0x7f9034155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 >> 172.21.15.78:0/2791678244 conn(0x7f90340cf7c0 msgr2=0x7f9034150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 shutdown_connections 2024-09-10T11:51:26.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:26.143+0000 7f903bc71640 1 -- 172.21.15.78:0/2791678244 wait complete. 2024-09-10T11:51:29.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:29.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 -- 172.21.15.78:0/2208303296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c806ff80 msgr2=0x7f03c8165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:29.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2208303296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c806ff80 0x7f03c8165340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009bc0 tx=0x7f03c001cb10 comp rx=0 tx=0).stop 2024-09-10T11:51:29.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 -- 172.21.15.78:0/2208303296 shutdown_connections 2024-09-10T11:51:29.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2208303296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c806ff80 0x7f03c8165340 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 -- 172.21.15.78:0/2208303296 >> 172.21.15.78:0/2208303296 conn(0x7f03c80cf7c0 msgr2=0x7f03c80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:29.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 -- 172.21.15.78:0/2208303296 shutdown_connections 2024-09-10T11:51:29.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.291+0000 7f03ce42b640 1 -- 172.21.15.78:0/2208303296 wait complete. 2024-09-10T11:51:29.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 Processor -- start 2024-09-10T11:51:29.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- start start 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03c806ff80 0x7f03c81593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03c80b3f40 0x7f03c8159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 0x7f03c8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81689a0 con 0x7f03c8158180 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03c8168820 con 0x7f03c80b3f40 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03c8168b20 con 0x7f03c806ff80 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 0x7f03c8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 0x7f03c8159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48104/0 (socket says 172.21.15.78:48104) 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 -- 172.21.15.78:0/2028946639 learned_addr learned my addr 172.21.15.78:0/2028946639 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03c77fe640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03c80b3f40 0x7f03c8159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03c7fff640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03c806ff80 0x7f03c81593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:29.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 -- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03c806ff80 msgr2=0x7f03c81593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03c806ff80 0x7f03c81593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 -- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03c80b3f40 msgr2=0x7f03c8159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03c80b3f40 0x7f03c8159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 -- 172.21.15.78:0/2028946639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c8153080 con 0x7f03c8158180 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03c77fe640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03c80b3f40 0x7f03c8159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03cc9c8640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 0x7f03c8159f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b0040 tx=0x7f03c0005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c00b2040 con 0x7f03c8158180 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03c00bb070 con 0x7f03c8158180 2024-09-10T11:51:29.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c8158810 con 0x7f03c8158180 2024-09-10T11:51:29.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0004590 con 0x7f03c8158180 2024-09-10T11:51:29.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c8155230 con 0x7f03c8158180 2024-09-10T11:51:29.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.295+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c806f870 con 0x7f03c8158180 2024-09-10T11:51:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.299+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f03c00a5a50 con 0x7f03c8158180 2024-09-10T11:51:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.299+0000 7f03c4ff9640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03b406f710 0x7f03b4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.299+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f03c012af50 con 0x7f03c8158180 2024-09-10T11:51:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.299+0000 7f03c7fff640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03b406f710 0x7f03b4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.299+0000 7f03c7fff640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03b406f710 0x7f03b4071bd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f03b8000f70 tx=0x7f03b8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:29.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.299+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f03c8158810 con 0x7f03c8158180 2024-09-10T11:51:29.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.483+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f03c8069310 con 0x7f03c8158180 2024-09-10T11:51:29.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03c4ff9640 1 -- 172.21.15.78:0/2028946639 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f03c8153080 con 0x7f03c8158180 2024-09-10T11:51:29.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:29.491 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:29.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03b406f710 msgr2=0x7f03b4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03b406f710 0x7f03b4071bd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f03b8000f70 tx=0x7f03b8009040 comp rx=0 tx=0).stop 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 msgr2=0x7f03c8159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 0x7f03c8159f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b0040 tx=0x7f03c0005b00 comp rx=0 tx=0).stop 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 shutdown_connections 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03c80b3f40 0x7f03c8159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f03b406f710 0x7f03b4071bd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c8158180 0x7f03c8159f50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 --2- 172.21.15.78:0/2028946639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03c806ff80 0x7f03c81593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 >> 172.21.15.78:0/2028946639 conn(0x7f03c80cf7c0 msgr2=0x7f03c80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 shutdown_connections 2024-09-10T11:51:29.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:29.487+0000 7f03ce42b640 1 -- 172.21.15.78:0/2028946639 wait complete. 2024-09-10T11:51:32.510 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:32.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 -- 172.21.15.78:0/4158790233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 msgr2=0x7f7e940cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:32.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 --2- 172.21.15.78:0/4158790233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e940cc3c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009840 tx=0x7f7e8401c760 comp rx=0 tx=0).stop 2024-09-10T11:51:32.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 -- 172.21.15.78:0/4158790233 shutdown_connections 2024-09-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 --2- 172.21.15.78:0/4158790233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e940cc3c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 -- 172.21.15.78:0/4158790233 >> 172.21.15.78:0/4158790233 conn(0x7f7e940d0990 msgr2=0x7f7e940d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 -- 172.21.15.78:0/4158790233 shutdown_connections 2024-09-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.639+0000 7f7e9c159640 1 -- 172.21.15.78:0/4158790233 wait complete. 2024-09-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 Processor -- start 2024-09-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- start start 2024-09-10T11:51:32.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e940cfdf0 0x7f7e94158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:32.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e94151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:32.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e94155e80 0x7f7e94156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7e940b00c0 con 0x7f7e940d14b0 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7e940aff40 con 0x7f7e94155e80 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7e940b0240 con 0x7f7e940cfdf0 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e94151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e94151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58840/0 (socket says 172.21.15.78:58840) 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 -- 172.21.15.78:0/3561140045 learned_addr learned my addr 172.21.15.78:0/3561140045 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9a6f6640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e94155e80 0x7f7e94156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 -- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e940cfdf0 msgr2=0x7f7e94158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e940cfdf0 0x7f7e94158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 -- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e94155e80 msgr2=0x7f7e94156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e94155e80 0x7f7e94156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 -- 172.21.15.78:0/3561140045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9414c6b0 con 0x7f7e940d14b0 2024-09-10T11:51:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e996f4640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e94151260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009790 tx=0x7f7e840040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840bb070 con 0x7f7e940d14b0 2024-09-10T11:51:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e84005030 con 0x7f7e940d14b0 2024-09-10T11:51:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9414c990 con 0x7f7e940d14b0 2024-09-10T11:51:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840b2040 con 0x7f7e940d14b0 2024-09-10T11:51:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9414cf50 con 0x7f7e940d14b0 2024-09-10T11:51:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9406abe0 con 0x7f7e940d14b0 2024-09-10T11:51:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f7e840be070 con 0x7f7e940d14b0 2024-09-10T11:51:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.643+0000 7f7e8a7fc640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f7e7806f710 0x7f7e78071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.647+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7e841291c0 con 0x7f7e940d14b0 2024-09-10T11:51:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.647+0000 7f7e99ef5640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f7e7806f710 0x7f7e78071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.647+0000 7f7e99ef5640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f7e7806f710 0x7f7e78071bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e94074080 tx=0x7f7e90006bd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:32.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.651+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f7e84016410 con 0x7f7e940d14b0 2024-09-10T11:51:32.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.835+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7e940cc3c0 con 0x7f7e940d14b0 2024-09-10T11:51:32.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.835+0000 7f7e8a7fc640 1 -- 172.21.15.78:0/3561140045 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f7e840f60e0 con 0x7f7e940d14b0 2024-09-10T11:51:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:32.843 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f7e7806f710 msgr2=0x7f7e78071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f7e7806f710 0x7f7e78071bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e94074080 tx=0x7f7e90006bd0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 msgr2=0x7f7e94151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e94151260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009790 tx=0x7f7e840040e0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 shutdown_connections 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e94155e80 0x7f7e94156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f7e7806f710 0x7f7e78071bd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e940d14b0 0x7f7e94151260 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 --2- 172.21.15.78:0/3561140045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e940cfdf0 0x7f7e94158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:32.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 >> 172.21.15.78:0/3561140045 conn(0x7f7e940d0990 msgr2=0x7f7e94154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:32.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 shutdown_connections 2024-09-10T11:51:32.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:32.839+0000 7f7e9c159640 1 -- 172.21.15.78:0/3561140045 wait complete. 2024-09-10T11:51:35.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 -- 172.21.15.78:0/1063957632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa598159c30 msgr2=0x7fa5980b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1063957632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa598159c30 0x7fa5980b2870 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5980aeeb0 tx=0x7fa58801dbb0 comp rx=0 tx=0).stop 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 -- 172.21.15.78:0/1063957632 shutdown_connections 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1063957632 >> v2:172.21.15.112:3300/0 conn(0x7fa5980aef20 0x7fa5980b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1063957632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa59815a010 0x7fa5980b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1063957632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa598159c30 0x7fa5980b2870 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 -- 172.21.15.78:0/1063957632 >> 172.21.15.78:0/1063957632 conn(0x7fa5980cf7c0 msgr2=0x7fa5980cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 -- 172.21.15.78:0/1063957632 shutdown_connections 2024-09-10T11:51:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.987+0000 7fa5a0133640 1 -- 172.21.15.78:0/1063957632 wait complete. 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 Processor -- start 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- start start 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 0x7fa598163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa598159c30 0x7fa59815eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa59815a010 0x7fa5980b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa59815e450 con 0x7fa5980aef20 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa59815e2d0 con 0x7fa59815a010 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa59815e5d0 con 0x7fa598159c30 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 0x7fa598163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 0x7fa598163270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58868/0 (socket says 172.21.15.78:58868) 2024-09-10T11:51:35.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 -- 172.21.15.78:0/1708522244 learned_addr learned my addr 172.21.15.78:0/1708522244 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59d6ce640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa598159c30 0x7fa59815eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 -- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa598159c30 msgr2=0x7fa59815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa598159c30 0x7fa59815eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59e6d0640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa59815a010 0x7fa5980b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 -- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa59815a010 msgr2=0x7fa5980b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa59815a010 0x7fa5980b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 -- 172.21.15.78:0/1708522244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59815f580 con 0x7fa5980aef20 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59d6ce640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa598159c30 0x7fa59815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa59decf640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 0x7fa598163270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa588000f90 tx=0x7fa5880a6a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5880bb020 con 0x7fa5980aef20 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa588004d40 con 0x7fa5980aef20 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59815f860 con 0x7fa5980aef20 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5880b3040 con 0x7fa5980aef20 2024-09-10T11:51:35.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa598152540 con 0x7fa5980aef20 2024-09-10T11:51:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.991+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5980b2870 con 0x7fa5980aef20 2024-09-10T11:51:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.995+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa588004320 con 0x7fa5980aef20 2024-09-10T11:51:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.995+0000 7fa5967fc640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f710 0x7fa584071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.995+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa588129e70 con 0x7fa5980aef20 2024-09-10T11:51:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.995+0000 7fa59d6ce640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f710 0x7fa584071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.995+0000 7fa59d6ce640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f710 0x7fa584071bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa5981459a0 tx=0x7fa58c005c20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:36.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:35.999+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fa5880c5060 con 0x7fa5980aef20 2024-09-10T11:51:36.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.179+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5980cfd40 con 0x7fa5980aef20 2024-09-10T11:51:36.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.179+0000 7fa5967fc640 1 -- 172.21.15.78:0/1708522244 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa588017860 con 0x7fa5980aef20 2024-09-10T11:51:36.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:36.186 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:36.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f710 msgr2=0x7fa584071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:36.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f710 0x7fa584071bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa5981459a0 tx=0x7fa58c005c20 comp rx=0 tx=0).stop 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 msgr2=0x7fa598163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 0x7fa598163270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa588000f90 tx=0x7fa5880a6a30 comp rx=0 tx=0).stop 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 shutdown_connections 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa59815a010 0x7fa5980b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa58406f710 0x7fa584071bd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa598159c30 0x7fa59815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 --2- 172.21.15.78:0/1708522244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5980aef20 0x7fa598163270 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 >> 172.21.15.78:0/1708522244 conn(0x7fa5980cf7c0 msgr2=0x7fa5981552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 shutdown_connections 2024-09-10T11:51:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:36.183+0000 7fa5a0133640 1 -- 172.21.15.78:0/1708522244 wait complete. 2024-09-10T11:51:39.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.335+0000 7f17e8b99640 1 -- 172.21.15.78:0/1926379746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40b4a10 msgr2=0x7f17e40d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.335+0000 7f17e8b99640 1 --2- 172.21.15.78:0/1926379746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40b4a10 0x7f17e40d4770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009bc0 tx=0x7f17dc01cb70 comp rx=0 tx=0).stop 2024-09-10T11:51:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.335+0000 7f17e8b99640 1 -- 172.21.15.78:0/1926379746 shutdown_connections 2024-09-10T11:51:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.335+0000 7f17e8b99640 1 --2- 172.21.15.78:0/1926379746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40b4a10 0x7f17e40d4770 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.335+0000 7f17e8b99640 1 -- 172.21.15.78:0/1926379746 >> 172.21.15.78:0/1926379746 conn(0x7f17e40d3c80 msgr2=0x7f17e40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- 172.21.15.78:0/1926379746 shutdown_connections 2024-09-10T11:51:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- 172.21.15.78:0/1926379746 wait complete. 2024-09-10T11:51:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 Processor -- start 2024-09-10T11:51:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- start start 2024-09-10T11:51:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17e40b4a10 0x7f17e41fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17e4161250 0x7f17e4153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 0x7f17e40ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f17e416bee0 con 0x7f17e4161630 2024-09-10T11:51:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17e416bd60 con 0x7f17e4161250 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17e416c060 con 0x7f17e40b4a10 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 0x7f17e40ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 0x7f17e40ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58876/0 (socket says 172.21.15.78:58876) 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 -- 172.21.15.78:0/3766268816 learned_addr learned my addr 172.21.15.78:0/3766268816 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17d9d9b640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17e4161250 0x7f17e4153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e259c640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17e40b4a10 0x7f17e41fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 -- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17e40b4a10 msgr2=0x7f17e41fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17e40b4a10 0x7f17e41fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 -- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17e4161250 msgr2=0x7f17e4153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17e4161250 0x7f17e4153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 -- 172.21.15.78:0/3766268816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e41f7ed0 con 0x7f17e4161630 2024-09-10T11:51:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17d9d9b640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17e4161250 0x7f17e4153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e2d9d640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 0x7f17e40ccf20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009b10 tx=0x7f17dc009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0ba020 con 0x7f17e4161630 2024-09-10T11:51:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17dc004d40 con 0x7f17e4161630 2024-09-10T11:51:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e41f81b0 con 0x7f17e4161630 2024-09-10T11:51:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0b2040 con 0x7f17e4161630 2024-09-10T11:51:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e41f8770 con 0x7f17e4161630 2024-09-10T11:51:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.339+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e40b1440 con 0x7f17e4161630 2024-09-10T11:51:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.343+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f17dc0a5ad0 con 0x7f17e4161630 2024-09-10T11:51:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.343+0000 7f17db7fe640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f17c406f710 0x7f17c4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.343+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f17dc12a800 con 0x7f17e4161630 2024-09-10T11:51:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.343+0000 7f17e259c640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f17c406f710 0x7f17c4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.343+0000 7f17e259c640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f17c406f710 0x7f17c4071bd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17d4001230 tx=0x7f17d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.347+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f17dc0c4020 con 0x7f17e4161630 2024-09-10T11:51:39.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.523+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f17e40d23e0 con 0x7f17e4161630 2024-09-10T11:51:39.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.523+0000 7f17db7fe640 1 -- 172.21.15.78:0/3766268816 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f17dc016790 con 0x7f17e4161630 2024-09-10T11:51:39.529 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:39.530 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f17c406f710 msgr2=0x7f17c4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f17c406f710 0x7f17c4071bd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17d4001230 tx=0x7f17d4009040 comp rx=0 tx=0).stop 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 msgr2=0x7f17e40ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 0x7f17e40ccf20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009b10 tx=0x7f17dc009300 comp rx=0 tx=0).stop 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 shutdown_connections 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17e4161250 0x7f17e4153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f17c406f710 0x7f17c4071bd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e4161630 0x7f17e40ccf20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 --2- 172.21.15.78:0/3766268816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17e40b4a10 0x7f17e41fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 >> 172.21.15.78:0/3766268816 conn(0x7f17e40d3c80 msgr2=0x7f17e406e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 shutdown_connections 2024-09-10T11:51:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:39.527+0000 7f17e8b99640 1 -- 172.21.15.78:0/3766268816 wait complete. 2024-09-10T11:51:42.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1352995457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac161630 msgr2=0x7f61ac0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1352995457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac161630 0x7f61ac0d0540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6194009900 tx=0x7f619401c8b0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1352995457 shutdown_connections 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1352995457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac161630 0x7f61ac0d0540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1352995457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61ac161250 0x7f61ac0d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1352995457 >> 172.21.15.78:0/1352995457 conn(0x7f61ac0d3c80 msgr2=0x7f61ac0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1352995457 shutdown_connections 2024-09-10T11:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1352995457 wait complete. 2024-09-10T11:51:42.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 Processor -- start 2024-09-10T11:51:42.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- start start 2024-09-10T11:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 0x7f61ac15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ac161250 0x7f61ac0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61ac161630 0x7f61ac0cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac16b290 con 0x7f61ac0b4a10 2024-09-10T11:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac16b110 con 0x7f61ac161250 2024-09-10T11:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f61ac16b410 con 0x7f61ac161630 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 0x7f61ac15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 0x7f61ac15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35550/0 (socket says 172.21.15.78:35550) 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 -- 172.21.15.78:0/1414865321 learned_addr learned my addr 172.21.15.78:0/1414865321 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61a37fe640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ac161250 0x7f61ac0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b0a61640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61ac161630 0x7f61ac0cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 -- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61ac161630 msgr2=0x7f61ac0cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61ac161630 0x7f61ac0cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 -- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ac161250 msgr2=0x7f61ac0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ac161250 0x7f61ac0cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 -- 172.21.15.78:0/1414865321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac15b9d0 con 0x7f61ac0b4a10 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61a37fe640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ac161250 0x7f61ac0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61abfff640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 0x7f61ac15ca70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f619c00c970 tx=0x7f619c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c007bb0 con 0x7f61ac0b4a10 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f619c005020 con 0x7f61ac0b4a10 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac15bcb0 con 0x7f61ac0b4a10 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c007e60 con 0x7f61ac0b4a10 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.679+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac15c270 con 0x7f61ac0b4a10 2024-09-10T11:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.683+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac15cfb0 con 0x7f61ac0b4a10 2024-09-10T11:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.683+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f619c005470 con 0x7f61ac0b4a10 2024-09-10T11:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.683+0000 7f61a97fa640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f618c06f710 0x7f618c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.683+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f619c090200 con 0x7f61ac0b4a10 2024-09-10T11:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.683+0000 7f61a37fe640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f618c06f710 0x7f618c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.683+0000 7f61a37fe640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f618c06f710 0x7f618c071bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61940af000 tx=0x7f619401b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.687+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f61ac15cfb0 con 0x7f61ac0b4a10 2024-09-10T11:51:42.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f61ac06e7c0 con 0x7f61ac0b4a10 2024-09-10T11:51:42.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61a97fa640 1 -- 172.21.15.78:0/1414865321 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f619c014030 con 0x7f61ac0b4a10 2024-09-10T11:51:42.872 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:42.872 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f618c06f710 msgr2=0x7f618c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f618c06f710 0x7f618c071bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61940af000 tx=0x7f619401b0f0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 msgr2=0x7f61ac15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 0x7f61ac15ca70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f619c00c970 tx=0x7f619c00ce30 comp rx=0 tx=0).stop 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.867+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 shutdown_connections 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ac161250 0x7f61ac0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f618c06f710 0x7f618c071bd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61ac161630 0x7f61ac0cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 --2- 172.21.15.78:0/1414865321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ac0b4a10 0x7f61ac15ca70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:42.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 >> 172.21.15.78:0/1414865321 conn(0x7f61ac0d3c80 msgr2=0x7f61ac0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:42.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 shutdown_connections 2024-09-10T11:51:42.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:42.871+0000 7f61b24c4640 1 -- 172.21.15.78:0/1414865321 wait complete. 2024-09-10T11:51:45.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 -- 172.21.15.78:0/759822957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7748159e60 msgr2=0x7f77480b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 --2- 172.21.15.78:0/759822957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7748159e60 0x7f77480b35d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7744009840 tx=0x7f774401c6d0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 -- 172.21.15.78:0/759822957 shutdown_connections 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 --2- 172.21.15.78:0/759822957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f774806fa50 0x7f77480b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 --2- 172.21.15.78:0/759822957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7748159e60 0x7f77480b35d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 -- 172.21.15.78:0/759822957 >> 172.21.15.78:0/759822957 conn(0x7f77480cf7c0 msgr2=0x7f77480cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 -- 172.21.15.78:0/759822957 shutdown_connections 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.019+0000 7f774ff4b640 1 -- 172.21.15.78:0/759822957 wait complete. 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 Processor -- start 2024-09-10T11:51:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- start start 2024-09-10T11:51:46.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 0x7f774814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:46.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77480aef90 0x7f7748141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7748159e60 0x7f774815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f774815e6f0 con 0x7f774806fa50 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f774815e570 con 0x7f7748159e60 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7748166b10 con 0x7f77480aef90 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 0x7f774814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 0x7f774814d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35562/0 (socket says 172.21.15.78:35562) 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 -- 172.21.15.78:0/933554052 learned_addr learned my addr 172.21.15.78:0/933554052 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 -- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77480aef90 msgr2=0x7f7748141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774d4e6640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77480aef90 0x7f7748141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77480aef90 0x7f7748141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 -- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7748159e60 msgr2=0x7f774815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774e4e8640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7748159e60 0x7f774815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7748159e60 0x7f774815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 -- 172.21.15.78:0/933554052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77480af5a0 con 0x7f774806fa50 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774dce7640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 0x7f774814d060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7744009790 tx=0x7f77440a64b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440ac070 con 0x7f774806fa50 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77440053b0 con 0x7f774806fa50 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440046d0 con 0x7f774806fa50 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77480af880 con 0x7f774806fa50 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77480afe40 con 0x7f774806fa50 2024-09-10T11:51:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774815d980 con 0x7f774806fa50 2024-09-10T11:51:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.023+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f77440af070 con 0x7f774806fa50 2024-09-10T11:51:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.027+0000 7f773e7fc640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f772c06f710 0x7f772c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.027+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7744129970 con 0x7f774806fa50 2024-09-10T11:51:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.027+0000 7f774d4e6640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f772c06f710 0x7f772c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.027+0000 7f774d4e6640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f772c06f710 0x7f772c071bd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77480cec40 tx=0x7f7738009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.031+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f7744016410 con 0x7f774806fa50 2024-09-10T11:51:46.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77481528c0 con 0x7f774806fa50 2024-09-10T11:51:46.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f773e7fc640 1 -- 172.21.15.78:0/933554052 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f77440f6800 con 0x7f774806fa50 2024-09-10T11:51:46.216 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:46.216 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:46.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f772c06f710 msgr2=0x7f772c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f772c06f710 0x7f772c071bd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77480cec40 tx=0x7f7738009040 comp rx=0 tx=0).stop 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 msgr2=0x7f774814d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 0x7f774814d060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7744009790 tx=0x7f77440a64b0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 shutdown_connections 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7748159e60 0x7f774815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f772c06f710 0x7f772c071bd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77480aef90 0x7f7748141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 --2- 172.21.15.78:0/933554052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f774806fa50 0x7f774814d060 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 >> 172.21.15.78:0/933554052 conn(0x7f77480cf7c0 msgr2=0x7f7748158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 shutdown_connections 2024-09-10T11:51:46.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:46.211+0000 7f774ff4b640 1 -- 172.21.15.78:0/933554052 wait complete. 2024-09-10T11:51:49.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/195795017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc415a010 msgr2=0x7f5fc40b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 --2- 172.21.15.78:0/195795017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc415a010 0x7f5fc40b35d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00a950 tx=0x7f5fac01dab0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/195795017 shutdown_connections 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 --2- 172.21.15.78:0/195795017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc415a010 0x7f5fc40b35d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 --2- 172.21.15.78:0/195795017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc4159c30 0x7f5fc40b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/195795017 >> 172.21.15.78:0/195795017 conn(0x7f5fc40cf7c0 msgr2=0x7f5fc40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/195795017 shutdown_connections 2024-09-10T11:51:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/195795017 wait complete. 2024-09-10T11:51:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 Processor -- start 2024-09-10T11:51:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- start start 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 0x7f5fc40ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fc4159c30 0x7f5fc40ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc415a010 0x7f5fc41577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4166b40 con 0x7f5fc40aef20 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc415e7d0 con 0x7f5fc4159c30 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc4166cc0 con 0x7f5fc415a010 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 0x7f5fc40ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 0x7f5fc40ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35588/0 (socket says 172.21.15.78:35588) 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 -- 172.21.15.78:0/319678037 learned_addr learned my addr 172.21.15.78:0/319678037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 -- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc415a010 msgr2=0x7f5fc41577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc8ad1640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc415a010 0x7f5fc41577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc37fe640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fc4159c30 0x7f5fc40ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc415a010 0x7f5fc41577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 -- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fc4159c30 msgr2=0x7f5fc40ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fc4159c30 0x7f5fc40ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 -- 172.21.15.78:0/319678037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc4145870 con 0x7f5fc40aef20 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc8ad1640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc415a010 0x7f5fc41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc3fff640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 0x7f5fc40ad8d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400cc60 tx=0x7f5fb400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400f650 con 0x7f5fc40aef20 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fb400f8e0 con 0x7f5fc40aef20 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc41452b0 con 0x7f5fc40aef20 2024-09-10T11:51:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400fd30 con 0x7f5fc40aef20 2024-09-10T11:51:49.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.367+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc4150ae0 con 0x7f5fc40aef20 2024-09-10T11:51:49.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.371+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc40b2870 con 0x7f5fc40aef20 2024-09-10T11:51:49.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.371+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f5fb4018400 con 0x7f5fc40aef20 2024-09-10T11:51:49.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.371+0000 7f5fc0ff9640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5fa406f710 0x7f5fa4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.371+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5fb4090a10 con 0x7f5fc40aef20 2024-09-10T11:51:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.371+0000 7f5fc37fe640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5fa406f710 0x7f5fa4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.371+0000 7f5fc37fe640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5fa406f710 0x7f5fa4071bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0b0000 tx=0x7f5fac01c2f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.375+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f5fb4026020 con 0x7f5fc40aef20 2024-09-10T11:51:49.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5fc40b4300 con 0x7f5fc40aef20 2024-09-10T11:51:49.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fc0ff9640 1 -- 172.21.15.78:0/319678037 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f5fb4014030 con 0x7f5fc40aef20 2024-09-10T11:51:49.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:49.567 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5fa406f710 msgr2=0x7f5fa4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5fa406f710 0x7f5fa4071bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0b0000 tx=0x7f5fac01c2f0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 msgr2=0x7f5fc40ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 0x7f5fc40ad8d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400cc60 tx=0x7f5fb400a620 comp rx=0 tx=0).stop 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 shutdown_connections 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fc4159c30 0x7f5fc40ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5fa406f710 0x7f5fa4071bd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fc415a010 0x7f5fc41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 --2- 172.21.15.78:0/319678037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc40aef20 0x7f5fc40ad8d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 >> 172.21.15.78:0/319678037 conn(0x7f5fc40cf7c0 msgr2=0x7f5fc4153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 shutdown_connections 2024-09-10T11:51:49.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:49.563+0000 7f5fca534640 1 -- 172.21.15.78:0/319678037 wait complete. 2024-09-10T11:51:50.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:51:50.674 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:51:52.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/1356931221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51c0003ae0 msgr2=0x7f51c0003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 --2- 172.21.15.78:0/1356931221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51c0003ae0 0x7f51c0003f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f51c8006f60 tx=0x7f51c801ceb0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d6d9d640 1 -- 172.21.15.78:0/1356931221 reap_dead start 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/1356931221 shutdown_connections 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/1356931221 >> 172.21.15.78:0/1356931221 conn(0x7f51d80d3c80 msgr2=0x7f51d80d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/1356931221 shutdown_connections 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/1356931221 wait complete. 2024-09-10T11:51:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 Processor -- start 2024-09-10T11:51:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- start start 2024-09-10T11:51:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51c0003ae0 0x7f51d815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 0x7f51d80b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d815f3a0 0x7f51d80c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f51d8169ed0 con 0x7f51d81fb2d0 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f51d8169d50 con 0x7f51d815f3a0 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f51d816a050 con 0x7f51c0003ae0 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 0x7f51d80b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 0x7f51d80b8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36824/0 (socket says 172.21.15.78:36824) 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 -- 172.21.15.78:0/2471684074 learned_addr learned my addr 172.21.15.78:0/2471684074 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d6d9d640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d815f3a0 0x7f51d80c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d659c640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51c0003ae0 0x7f51d815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 -- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51c0003ae0 msgr2=0x7f51d815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51c0003ae0 0x7f51d815d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 -- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d815f3a0 msgr2=0x7f51d80c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d815f3a0 0x7f51d80c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 -- 172.21.15.78:0/2471684074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d81fbac0 con 0x7f51d81fb2d0 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d6d9d640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d815f3a0 0x7f51d80c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51d5d9b640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 0x7f51d80b8780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f51cc004ee0 tx=0x7f51cc0015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc015020 con 0x7f51d81fb2d0 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51cc011960 con 0x7f51d81fb2d0 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d81fbda0 con 0x7f51d81fb2d0 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011d90 con 0x7f51d81fb2d0 2024-09-10T11:51:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.715+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d815ee80 con 0x7f51d81fb2d0 2024-09-10T11:51:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.719+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d80b8d80 con 0x7f51d81fb2d0 2024-09-10T11:51:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.719+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f51cc018020 con 0x7f51d81fb2d0 2024-09-10T11:51:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.719+0000 7f51c6ffd640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f51b806f710 0x7f51b8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.719+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f51cc090890 con 0x7f51d81fb2d0 2024-09-10T11:51:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.719+0000 7f51d659c640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f51b806f710 0x7f51b8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.719+0000 7f51d659c640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f51b806f710 0x7f51b8071bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f51c80ab000 tx=0x7f51c80a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.723+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f51cc01f020 con 0x7f51d81fb2d0 2024-09-10T11:51:52.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51d80d0540 con 0x7f51d81fb2d0 2024-09-10T11:51:52.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51c6ffd640 1 -- 172.21.15.78:0/2471684074 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f51cc05d890 con 0x7f51d81fb2d0 2024-09-10T11:51:52.915 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:52.915 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:52.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f51b806f710 msgr2=0x7f51b8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:52.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f51b806f710 0x7f51b8071bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f51c80ab000 tx=0x7f51c80a7040 comp rx=0 tx=0).stop 2024-09-10T11:51:52.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 msgr2=0x7f51d80b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:52.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 0x7f51d80b8780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f51cc004ee0 tx=0x7f51cc0015e0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 shutdown_connections 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d815f3a0 0x7f51d80c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f51b806f710 0x7f51b8071bd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51d81fb2d0 0x7f51d80b8780 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 --2- 172.21.15.78:0/2471684074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51c0003ae0 0x7f51d815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 >> 172.21.15.78:0/2471684074 conn(0x7f51d80d3c80 msgr2=0x7f51d80b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 shutdown_connections 2024-09-10T11:51:52.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:52.911+0000 7f51dcb35640 1 -- 172.21.15.78:0/2471684074 wait complete. 2024-09-10T11:51:55.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 -- 172.21.15.78:0/1964779950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 msgr2=0x7fd3e8073450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1964779950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 0x7fd3e8073450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009bc0 tx=0x7fd3e001cb10 comp rx=0 tx=0).stop 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 -- 172.21.15.78:0/1964779950 shutdown_connections 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1964779950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 0x7fd3e8073450 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1964779950 >> v2:172.21.15.112:3300/0 conn(0x7fd3e80b3f40 0x7fd3e806f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 -- 172.21.15.78:0/1964779950 >> 172.21.15.78:0/1964779950 conn(0x7fd3e80cf7c0 msgr2=0x7fd3e80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 -- 172.21.15.78:0/1964779950 shutdown_connections 2024-09-10T11:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.063+0000 7fd3edf74640 1 -- 172.21.15.78:0/1964779950 wait complete. 2024-09-10T11:51:56.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 Processor -- start 2024-09-10T11:51:56.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- start start 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 0x7fd3e80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 0x7fd3e81fa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e8158180 0x7fd3e80adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8167560 con 0x7fd3e80b3f40 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8074450 con 0x7fd3e8158180 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e81676e0 con 0x7fd3e806fdb0 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 0x7fd3e81fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 0x7fd3e81fa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36834/0 (socket says 172.21.15.78:36834) 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 -- 172.21.15.78:0/1397755520 learned_addr learned my addr 172.21.15.78:0/1397755520 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e7fff640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e8158180 0x7fd3e80adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e77fe640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 0x7fd3e80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 -- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 msgr2=0x7fd3e80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 0x7fd3e80ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 -- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e8158180 msgr2=0x7fd3e80adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e8158180 0x7fd3e80adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 -- 172.21.15.78:0/1397755520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e81f7210 con 0x7fd3e80b3f40 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3e6ffd640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 0x7fd3e81fa800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00e9f0 tx=0x7fd3dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00cd80 con 0x7fd3e80b3f40 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3dc004020 con 0x7fd3e80b3f40 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e81fafe0 con 0x7fd3e80b3f40 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004470 con 0x7fd3e80b3f40 2024-09-10T11:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e81fb5a0 con 0x7fd3e80b3f40 2024-09-10T11:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.067+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e8073450 con 0x7fd3e80b3f40 2024-09-10T11:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.071+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd3dc003600 con 0x7fd3e80b3f40 2024-09-10T11:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.071+0000 7fd3cffff640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd3d406f710 0x7fd3d4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.071+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd3dc090460 con 0x7fd3e80b3f40 2024-09-10T11:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.071+0000 7fd3e77fe640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd3d406f710 0x7fd3d4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.071+0000 7fd3e77fe640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd3d406f710 0x7fd3d4071bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8001650 tx=0x7fd3d8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.075+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd3e81f7210 con 0x7fd3e80b3f40 2024-09-10T11:51:56.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd3e815c110 con 0x7fd3e80b3f40 2024-09-10T11:51:56.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3cffff640 1 -- 172.21.15.78:0/1397755520 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd3dc05d2e0 con 0x7fd3e80b3f40 2024-09-10T11:51:56.256 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:56.256 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd3d406f710 msgr2=0x7fd3d4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd3d406f710 0x7fd3d4071bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8001650 tx=0x7fd3d8009040 comp rx=0 tx=0).stop 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 msgr2=0x7fd3e81fa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 0x7fd3e81fa800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00e9f0 tx=0x7fd3dc00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 shutdown_connections 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e8158180 0x7fd3e80adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd3d406f710 0x7fd3d4071bd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e80b3f40 0x7fd3e81fa800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 --2- 172.21.15.78:0/1397755520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3e806fdb0 0x7fd3e80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 >> 172.21.15.78:0/1397755520 conn(0x7fd3e80cf7c0 msgr2=0x7fd3e815b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 shutdown_connections 2024-09-10T11:51:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:56.251+0000 7fd3edf74640 1 -- 172.21.15.78:0/1397755520 wait complete. 2024-09-10T11:51:59.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:51:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 -- 172.21.15.78:0/4160737521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 msgr2=0x7f047815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 --2- 172.21.15.78:0/4160737521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f047815f650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0468009840 tx=0x7f046801f010 comp rx=0 tx=0).stop 2024-09-10T11:51:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 -- 172.21.15.78:0/4160737521 shutdown_connections 2024-09-10T11:51:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 --2- 172.21.15.78:0/4160737521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f047806ded0 0x7f047806e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 --2- 172.21.15.78:0/4160737521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f047815f650 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 -- 172.21.15.78:0/4160737521 >> 172.21.15.78:0/4160737521 conn(0x7f04780cf7c0 msgr2=0x7f04780cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 -- 172.21.15.78:0/4160737521 shutdown_connections 2024-09-10T11:51:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 -- 172.21.15.78:0/4160737521 wait complete. 2024-09-10T11:51:59.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 Processor -- start 2024-09-10T11:51:59.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.407+0000 7f047e512640 1 -- start start 2024-09-10T11:51:59.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f047806ded0 0x7f04781e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:59.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f047815bc80 0x7f047814a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:59.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f04781e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:59.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04780cecc0 con 0x7f047815f270 2024-09-10T11:51:59.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f04780ceb40 con 0x7f047806ded0 2024-09-10T11:51:59.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f04780cee40 con 0x7f047815bc80 2024-09-10T11:51:59.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f04781e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:59.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f04781e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36856/0 (socket says 172.21.15.78:36856) 2024-09-10T11:51:59.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 -- 172.21.15.78:0/74053134 learned_addr learned my addr 172.21.15.78:0/74053134 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:51:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 -- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f047815bc80 msgr2=0x7f047814a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0477fff640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f047806ded0 0x7f04781e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f04777fe640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f047815bc80 0x7f047814a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f047815bc80 0x7f047814a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 -- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f047806ded0 msgr2=0x7f04781e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f047806ded0 0x7f04781e9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 -- 172.21.15.78:0/74053134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04781e6c50 con 0x7f047815f270 2024-09-10T11:51:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0477fff640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f047806ded0 0x7f04781e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:51:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047caaf640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f04781e7cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f047000cbc0 tx=0x7f047000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470016020 con 0x7f047815f270 2024-09-10T11:51:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f047000ab40 con 0x7f047815f270 2024-09-10T11:51:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04781e6f30 con 0x7f047815f270 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470012420 con 0x7f047815f270 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04781e74f0 con 0x7f047815f270 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047815c9c0 con 0x7f047815f270 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f0470019020 con 0x7f047815f270 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0474ff9640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f045806f740 0x7f0458071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f047008f9e0 con 0x7f047815f270 2024-09-10T11:51:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.411+0000 7f0477fff640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f045806f740 0x7f0458071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:51:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.415+0000 7f0477fff640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f045806f740 0x7f0458071c00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f04680b2000 tx=0x7f046801d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:51:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.415+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0470020020 con 0x7f047815f270 2024-09-10T11:51:59.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.599+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f04781e5bf0 con 0x7f047815f270 2024-09-10T11:51:59.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.599+0000 7f0474ff9640 1 -- 172.21.15.78:0/74053134 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f047005c990 con 0x7f047815f270 2024-09-10T11:51:59.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:51:59.606 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:51:59.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f045806f740 msgr2=0x7f0458071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f045806f740 0x7f0458071c00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f04680b2000 tx=0x7f046801d850 comp rx=0 tx=0).stop 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 msgr2=0x7f04781e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f04781e7cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f047000cbc0 tx=0x7f047000ccb0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 shutdown_connections 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f045806f740 0x7f0458071c00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f047815f270 0x7f04781e7cf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f047815bc80 0x7f047814a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 --2- 172.21.15.78:0/74053134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f047806ded0 0x7f04781e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 >> 172.21.15.78:0/74053134 conn(0x7f04780cf7c0 msgr2=0x7f047815cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 shutdown_connections 2024-09-10T11:51:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:51:59.603+0000 7f047e512640 1 -- 172.21.15.78:0/74053134 wait complete. 2024-09-10T11:52:02.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 -- 172.21.15.78:0/1093023662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 msgr2=0x7f9f9006e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1093023662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 0x7f9f9006e1e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009900 tx=0x7f9f7801c820 comp rx=0 tx=0).stop 2024-09-10T11:52:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 -- 172.21.15.78:0/1093023662 shutdown_connections 2024-09-10T11:52:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1093023662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 0x7f9f9006e1e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1093023662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f901528c0 0x7f9f900b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 -- 172.21.15.78:0/1093023662 >> 172.21.15.78:0/1093023662 conn(0x7f9f900cf7c0 msgr2=0x7f9f900cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 -- 172.21.15.78:0/1093023662 shutdown_connections 2024-09-10T11:52:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.763+0000 7f9f96a56640 1 -- 172.21.15.78:0/1093023662 wait complete. 2024-09-10T11:52:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 Processor -- start 2024-09-10T11:52:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- start start 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f9006e720 0x7f9f90149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 0x7f9f9015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 0x7f9f900b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9f90168a70 con 0x7f9f901528c0 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f901688f0 con 0x7f9f900b54b0 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9f90168bf0 con 0x7f9f9006e720 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 0x7f9f900b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 0x7f9f900b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52164/0 (socket says 172.21.15.78:52164) 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 -- 172.21.15.78:0/1078466792 learned_addr learned my addr 172.21.15.78:0/1078466792 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f8ffff640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f9006e720 0x7f9f90149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f87fff640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 0x7f9f9015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 -- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f9006e720 msgr2=0x7f9f90149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f9006e720 0x7f9f90149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 -- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 msgr2=0x7f9f9015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 0x7f9f9015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 -- 172.21.15.78:0/1078466792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9014b830 con 0x7f9f901528c0 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f8ffff640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f9006e720 0x7f9f90149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f94ff3640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 0x7f9f900b0da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c7a0 tx=0x7f9f8800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88003b80 con 0x7f9f901528c0 2024-09-10T11:52:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f88003d40 con 0x7f9f901528c0 2024-09-10T11:52:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800aab0 con 0x7f9f901528c0 2024-09-10T11:52:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9014a4b0 con 0x7f9f901528c0 2024-09-10T11:52:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9014aa70 con 0x7f9f901528c0 2024-09-10T11:52:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.767+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9006e1e0 con 0x7f9f901528c0 2024-09-10T11:52:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.771+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f9f8800ac50 con 0x7f9f901528c0 2024-09-10T11:52:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.771+0000 7f9f8d7fa640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9f7006f710 0x7f9f70071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.771+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9f880900b0 con 0x7f9f901528c0 2024-09-10T11:52:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.771+0000 7f9f8ffff640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9f7006f710 0x7f9f70071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.771+0000 7f9f8ffff640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9f7006f710 0x7f9f70071bd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f900cbfe0 tx=0x7f9f800091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.775+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f9f9014b830 con 0x7f9f901528c0 2024-09-10T11:52:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.951+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9f9015d2f0 con 0x7f9f901528c0 2024-09-10T11:52:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.951+0000 7f9f8d7fa640 1 -- 172.21.15.78:0/1078466792 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f9f90152ca0 con 0x7f9f901528c0 2024-09-10T11:52:02.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:02.952 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9f7006f710 msgr2=0x7f9f70071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9f7006f710 0x7f9f70071bd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f900cbfe0 tx=0x7f9f800091e0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 msgr2=0x7f9f900b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 0x7f9f900b0da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c7a0 tx=0x7f9f8800cc60 comp rx=0 tx=0).stop 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 shutdown_connections 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f900b54b0 0x7f9f9015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9f7006f710 0x7f9f70071bd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f901528c0 0x7f9f900b0da0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 --2- 172.21.15.78:0/1078466792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f9006e720 0x7f9f90149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 >> 172.21.15.78:0/1078466792 conn(0x7f9f900cf7c0 msgr2=0x7f9f9014e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 shutdown_connections 2024-09-10T11:52:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:02.955+0000 7f9f96a56640 1 -- 172.21.15.78:0/1078466792 wait complete. 2024-09-10T11:52:05.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 -- 172.21.15.78:0/3783370112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 msgr2=0x7f499c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 --2- 172.21.15.78:0/3783370112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f499c004c90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009b30 tx=0x7f49a001d270 comp rx=0 tx=0).stop 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 -- 172.21.15.78:0/3783370112 shutdown_connections 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 --2- 172.21.15.78:0/3783370112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f499c004c90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 -- 172.21.15.78:0/3783370112 >> 172.21.15.78:0/3783370112 conn(0x7f49b00cf7c0 msgr2=0x7f49b00cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 -- 172.21.15.78:0/3783370112 shutdown_connections 2024-09-10T11:52:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.103+0000 7f49b659d640 1 -- 172.21.15.78:0/3783370112 wait complete. 2024-09-10T11:52:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 Processor -- start 2024-09-10T11:52:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- start start 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f49b00b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49b01f5300 0x7f49b0151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b00aec90 0x7f49b00af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f49b006fc00 con 0x7f499c004810 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49b006fa80 con 0x7f49b00aec90 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f49b015b750 con 0x7f49b01f5300 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f49b00b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f49b00b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52176/0 (socket says 172.21.15.78:52176) 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 -- 172.21.15.78:0/2318654296 learned_addr learned my addr 172.21.15.78:0/2318654296 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49a77fe640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49b01f5300 0x7f49b0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 -- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49b01f5300 msgr2=0x7f49b0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49b01f5300 0x7f49b0151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 -- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b00aec90 msgr2=0x7f49b00af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b4b3a640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b00aec90 0x7f49b00af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b00aec90 0x7f49b00af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 -- 172.21.15.78:0/2318654296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b0151880 con 0x7f499c004810 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49affff640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f49b00b19d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f499800f740 tx=0x7f499800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499800a960 con 0x7f499c004810 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f499800abf0 con 0x7f499c004810 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998012470 con 0x7f499c004810 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b00c4880 con 0x7f499c004810 2024-09-10T11:52:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b00c4e40 con 0x7f499c004810 2024-09-10T11:52:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.107+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b00ae510 con 0x7f499c004810 2024-09-10T11:52:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.111+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f4998012610 con 0x7f499c004810 2024-09-10T11:52:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.111+0000 7f49ad7fa640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f499006f740 0x7f4990071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.111+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4998092dd0 con 0x7f499c004810 2024-09-10T11:52:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.111+0000 7f49a77fe640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f499006f740 0x7f4990071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.111+0000 7f49a77fe640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f499006f740 0x7f4990071c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ae000 tx=0x7f49a001a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:06.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.115+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f4998017030 con 0x7f499c004810 2024-09-10T11:52:06.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.299+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49b006e060 con 0x7f499c004810 2024-09-10T11:52:06.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.299+0000 7f49ad7fa640 1 -- 172.21.15.78:0/2318654296 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f499805fcf0 con 0x7f499c004810 2024-09-10T11:52:06.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:06.300 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:06.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f499006f740 msgr2=0x7f4990071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:06.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f499006f740 0x7f4990071c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ae000 tx=0x7f49a001a010 comp rx=0 tx=0).stop 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 msgr2=0x7f49b00b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f49b00b19d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f499800f740 tx=0x7f499800fc00 comp rx=0 tx=0).stop 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 shutdown_connections 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b00aec90 0x7f49b00af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f499006f740 0x7f4990071c00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49b01f5300 0x7f49b0151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 --2- 172.21.15.78:0/2318654296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f499c004810 0x7f49b00b19d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 >> 172.21.15.78:0/2318654296 conn(0x7f49b00cf7c0 msgr2=0x7f49b00b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 shutdown_connections 2024-09-10T11:52:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:06.303+0000 7f49b659d640 1 -- 172.21.15.78:0/2318654296 wait complete. 2024-09-10T11:52:09.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/139154951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b80003a60 msgr2=0x7f0b80003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/139154951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b80003a60 0x7f0b80003e80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b88006fd0 tx=0x7f0b8801f6a0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/139154951 shutdown_connections 2024-09-10T11:52:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/139154951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b80003a60 0x7f0b80003e80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/139154951 >> 172.21.15.78:0/139154951 conn(0x7f0b980cf7c0 msgr2=0x7f0b980cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/139154951 shutdown_connections 2024-09-10T11:52:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.455+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/139154951 wait complete. 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 Processor -- start 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- start start 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b80003a60 0x7f0b981ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b980ab220 0x7f0b980ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 0x7f0b98140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9815f9e0 con 0x7f0b9813fde0 2024-09-10T11:52:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9815f860 con 0x7f0b80003a60 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9815fb60 con 0x7f0b980ab220 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 0x7f0b98140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 0x7f0b98140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52190/0 (socket says 172.21.15.78:52190) 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 -- 172.21.15.78:0/1781947012 learned_addr learned my addr 172.21.15.78:0/1781947012 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9d64d640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b80003a60 0x7f0b981ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9ce4c640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b980ab220 0x7f0b980ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 -- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b980ab220 msgr2=0x7f0b980ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b980ab220 0x7f0b980ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 -- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b80003a60 msgr2=0x7f0b981ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b80003a60 0x7f0b981ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 -- 172.21.15.78:0/1781947012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b981efe10 con 0x7f0b9813fde0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9d64d640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b80003a60 0x7f0b981ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9ce4c640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b980ab220 0x7f0b980ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9de4e640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 0x7f0b98140290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b9815bc50 tx=0x7f0b90010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90004030 con 0x7f0b9813fde0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b900042e0 con 0x7f0b9813fde0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90005280 con 0x7f0b9813fde0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b98140bb0 con 0x7f0b9813fde0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b980ad710 con 0x7f0b9813fde0 2024-09-10T11:52:09.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.459+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9806e610 con 0x7f0b9813fde0 2024-09-10T11:52:09.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.463+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f0b9001c020 con 0x7f0b9813fde0 2024-09-10T11:52:09.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.463+0000 7f0b8dffb640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b8406f740 0x7f0b84071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:09.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.463+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0b9008f730 con 0x7f0b9813fde0 2024-09-10T11:52:09.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.463+0000 7f0b9d64d640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b8406f740 0x7f0b84071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:09.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.463+0000 7f0b9d64d640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b8406f740 0x7f0b84071c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b880b0000 tx=0x7f0b88005040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:09.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.467+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0b9005c650 con 0x7f0b9813fde0 2024-09-10T11:52:09.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.639+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b980b3c50 con 0x7f0b9813fde0 2024-09-10T11:52:09.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.639+0000 7f0b8dffb640 1 -- 172.21.15.78:0/1781947012 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f0b9005bf50 con 0x7f0b9813fde0 2024-09-10T11:52:09.641 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:09.641 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:09.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b8406f740 msgr2=0x7f0b84071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:09.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b8406f740 0x7f0b84071c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b880b0000 tx=0x7f0b88005040 comp rx=0 tx=0).stop 2024-09-10T11:52:09.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 msgr2=0x7f0b98140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 0x7f0b98140290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b9815bc50 tx=0x7f0b90010b70 comp rx=0 tx=0).stop 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 shutdown_connections 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0b8406f740 0x7f0b84071c00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9813fde0 0x7f0b98140290 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b980ab220 0x7f0b980ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 --2- 172.21.15.78:0/1781947012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b80003a60 0x7f0b981ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:09.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 >> 172.21.15.78:0/1781947012 conn(0x7f0b980cf7c0 msgr2=0x7f0b980b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:09.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 shutdown_connections 2024-09-10T11:52:09.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:09.643+0000 7f0b9f8b1640 1 -- 172.21.15.78:0/1781947012 wait complete. 2024-09-10T11:52:12.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 -- 172.21.15.78:0/4011070692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f104806e720 msgr2=0x7f104815f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 --2- 172.21.15.78:0/4011070692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f104806e720 0x7f104815f350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f10480d0590 tx=0x7f104001ca00 comp rx=0 tx=0).stop 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 -- 172.21.15.78:0/4011070692 shutdown_connections 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 --2- 172.21.15.78:0/4011070692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f104806e720 0x7f104815f350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 --2- 172.21.15.78:0/4011070692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10480b54b0 0x7f104806e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 --2- 172.21.15.78:0/4011070692 >> v2:172.21.15.112:3300/0 conn(0x7f10481528c0 0x7f10480b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 -- 172.21.15.78:0/4011070692 >> 172.21.15.78:0/4011070692 conn(0x7f10480cf7c0 msgr2=0x7f10480cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 -- 172.21.15.78:0/4011070692 shutdown_connections 2024-09-10T11:52:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 -- 172.21.15.78:0/4011070692 wait complete. 2024-09-10T11:52:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 Processor -- start 2024-09-10T11:52:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.798+0000 7f104f5a4640 1 -- start start 2024-09-10T11:52:12.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f104806e720 0x7f10481460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:12.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 0x7f10481465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10481528c0 0x7f10480af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10480ce420 con 0x7f10480b54b0 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10480ce2a0 con 0x7f104806e720 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f10480ce5a0 con 0x7f10481528c0 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 0x7f10481465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 0x7f10481465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49640/0 (socket says 172.21.15.78:49640) 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 -- 172.21.15.78:0/3335672609 learned_addr learned my addr 172.21.15.78:0/3335672609 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104d340640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f104806e720 0x7f10481460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 -- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10481528c0 msgr2=0x7f10480af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10481528c0 0x7f10480af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 -- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f104806e720 msgr2=0x7f10481460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f104806e720 0x7f10481460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 -- 172.21.15.78:0/3335672609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104814f510 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104d340640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f104806e720 0x7f10481460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104cb3f640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 0x7f10481465e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f103800d750 tx=0x7f103800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038017070 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1038009d20 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1048146cd0 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103800de60 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1048146fb0 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104806e1e0 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1038005280 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f103dffb640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f102c06f740 0x7f102c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f103808f9c0 con 0x7f10480b54b0 2024-09-10T11:52:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.802+0000 7f104d340640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f102c06f740 0x7f102c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.806+0000 7f104d340640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f102c06f740 0x7f102c071c00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1044005fd0 tx=0x7f1044005de0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.806+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f103805c840 con 0x7f10480b54b0 2024-09-10T11:52:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.982+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1048069310 con 0x7f10480b54b0 2024-09-10T11:52:12.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.982+0000 7f103dffb640 1 -- 172.21.15.78:0/3335672609 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f103805c140 con 0x7f10480b54b0 2024-09-10T11:52:12.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:12.986 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f102c06f740 msgr2=0x7f102c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f102c06f740 0x7f102c071c00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1044005fd0 tx=0x7f1044005de0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 msgr2=0x7f10481465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 0x7f10481465e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f103800d750 tx=0x7f103800dc10 comp rx=0 tx=0).stop 2024-09-10T11:52:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 shutdown_connections 2024-09-10T11:52:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f102c06f740 0x7f102c071c00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10481528c0 0x7f10480af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10480b54b0 0x7f10481465e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 --2- 172.21.15.78:0/3335672609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f104806e720 0x7f10481460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 >> 172.21.15.78:0/3335672609 conn(0x7f10480cf7c0 msgr2=0x7f10480cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 shutdown_connections 2024-09-10T11:52:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:12.986+0000 7f104f5a4640 1 -- 172.21.15.78:0/3335672609 wait complete. 2024-09-10T11:52:16.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:16.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/2333298009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 msgr2=0x7f1be0003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/2333298009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1be0003eb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1bec006fa0 tx=0x7f1bec01ce90 comp rx=0 tx=0).stop 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf77fe640 1 -- 172.21.15.78:0/2333298009 reap_dead start 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/2333298009 shutdown_connections 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/2333298009 >> 172.21.15.78:0/2333298009 conn(0x7f1bf80cf7c0 msgr2=0x7f1bf80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/2333298009 shutdown_connections 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/2333298009 wait complete. 2024-09-10T11:52:16.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 Processor -- start 2024-09-10T11:52:16.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- start start 2024-09-10T11:52:16.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1bf81490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1bf8151d00 0x7f1bf8152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf81564e0 0x7f1bf8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81665b0 con 0x7f1be0003a90 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8166430 con 0x7f1bf81564e0 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf8166730 con 0x7f1bf8151d00 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1bf81490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1bf81490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49658/0 (socket says 172.21.15.78:49658) 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 -- 172.21.15.78:0/3684959638 learned_addr learned my addr 172.21.15.78:0/3684959638 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf67fc640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1bf8151d00 0x7f1bf8152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 -- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1bf8151d00 msgr2=0x7f1bf8152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1bf8151d00 0x7f1bf8152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 -- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf81564e0 msgr2=0x7f1bf8156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf77fe640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf81564e0 0x7f1bf8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf81564e0 0x7f1bf8156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 -- 172.21.15.78:0/3684959638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf80b0850 con 0x7f1be0003a90 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bf6ffd640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1bf81490b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1bec01b590 tx=0x7f1bec006bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec006090 con 0x7f1be0003a90 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bec003600 con 0x7f1be0003a90 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf81f55f0 con 0x7f1be0003a90 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0039d0 con 0x7f1be0003a90 2024-09-10T11:52:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.138+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf81f5bb0 con 0x7f1be0003a90 2024-09-10T11:52:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.142+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf806f870 con 0x7f1be0003a90 2024-09-10T11:52:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.142+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f1bec003b70 con 0x7f1be0003a90 2024-09-10T11:52:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.142+0000 7f1bdf7fe640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1be406f740 0x7f1be4071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.142+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1bec12a110 con 0x7f1be0003a90 2024-09-10T11:52:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.142+0000 7f1bf67fc640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1be406f740 0x7f1be4071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.142+0000 7f1bf67fc640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1be406f740 0x7f1be4071c00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1be8000c10 tx=0x7f1be8006a50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.146+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f1bec016c70 con 0x7f1be0003a90 2024-09-10T11:52:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.330+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1bf815efd0 con 0x7f1be0003a90 2024-09-10T11:52:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.330+0000 7f1bdf7fe640 1 -- 172.21.15.78:0/3684959638 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1bec0f71d0 con 0x7f1be0003a90 2024-09-10T11:52:16.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:16.334 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1be406f740 msgr2=0x7f1be4071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1be406f740 0x7f1be4071c00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1be8000c10 tx=0x7f1be8006a50 comp rx=0 tx=0).stop 2024-09-10T11:52:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 msgr2=0x7f1bf81490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1bf81490b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1bec01b590 tx=0x7f1bec006bc0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 shutdown_connections 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf81564e0 0x7f1bf8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f1be406f740 0x7f1be4071c00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1bf8151d00 0x7f1bf8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 --2- 172.21.15.78:0/3684959638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1be0003a90 0x7f1bf81490b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 >> 172.21.15.78:0/3684959638 conn(0x7f1bf80cf7c0 msgr2=0x7f1bf81572f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 shutdown_connections 2024-09-10T11:52:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:16.334+0000 7f1bfd74a640 1 -- 172.21.15.78:0/3684959638 wait complete. 2024-09-10T11:52:19.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 -- 172.21.15.78:0/3758620293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c0cee70 msgr2=0x7f677c06e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3758620293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c0cee70 0x7f677c06e810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6774009840 tx=0x7f677401c820 comp rx=0 tx=0).stop 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 -- 172.21.15.78:0/3758620293 shutdown_connections 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3758620293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c0cee70 0x7f677c06e810 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 -- 172.21.15.78:0/3758620293 >> 172.21.15.78:0/3758620293 conn(0x7f677c0cf7c0 msgr2=0x7f677c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 -- 172.21.15.78:0/3758620293 shutdown_connections 2024-09-10T11:52:19.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.486+0000 7f6782ed3640 1 -- 172.21.15.78:0/3758620293 wait complete. 2024-09-10T11:52:19.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 Processor -- start 2024-09-10T11:52:19.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- start start 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f677c0cc090 0x7f677c14ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f677c0cee70 0x7f677c151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 0x7f677c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f677c169970 con 0x7f677c15fa70 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f677c1697f0 con 0x7f677c0cc090 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f677c169af0 con 0x7f677c0cee70 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 0x7f677c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 0x7f677c152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49678/0 (socket says 172.21.15.78:49678) 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 -- 172.21.15.78:0/3079043431 learned_addr learned my addr 172.21.15.78:0/3079043431 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6780c6f640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f677c0cc090 0x7f677c14ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f677bfff640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f677c0cee70 0x7f677c151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:19.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 -- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f677c0cee70 msgr2=0x7f677c151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f677c0cee70 0x7f677c151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 -- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f677c0cc090 msgr2=0x7f677c14ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f677c0cc090 0x7f677c14ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 -- 172.21.15.78:0/3079043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c150c80 con 0x7f677c15fa70 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6781470640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 0x7f677c152260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6774009790 tx=0x7f67740a5570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67740b2040 con 0x7f677c15fa70 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67740043b0 con 0x7f677c15fa70 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774005260 con 0x7f677c15fa70 2024-09-10T11:52:19.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c150f60 con 0x7f677c15fa70 2024-09-10T11:52:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c151520 con 0x7f677c15fa70 2024-09-10T11:52:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c15f360 con 0x7f677c15fa70 2024-09-10T11:52:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.490+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f67740be060 con 0x7f677c15fa70 2024-09-10T11:52:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.494+0000 7f67797fa640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f675c06f710 0x7f675c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.494+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6774129290 con 0x7f677c15fa70 2024-09-10T11:52:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.494+0000 7f6780c6f640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f675c06f710 0x7f675c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:19.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.494+0000 7f6780c6f640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f675c06f710 0x7f675c071bd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f677c158c30 tx=0x7f676c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:19.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.494+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f6774016410 con 0x7f677c15fa70 2024-09-10T11:52:19.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f677c0cff50 con 0x7f677c15fa70 2024-09-10T11:52:19.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f67797fa640 1 -- 172.21.15.78:0/3079043431 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f67740f6320 con 0x7f677c15fa70 2024-09-10T11:52:19.667 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:19.667 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:19.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f675c06f710 msgr2=0x7f675c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:19.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f675c06f710 0x7f675c071bd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f677c158c30 tx=0x7f676c009040 comp rx=0 tx=0).stop 2024-09-10T11:52:19.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 msgr2=0x7f677c152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:19.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 0x7f677c152260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6774009790 tx=0x7f67740a5570 comp rx=0 tx=0).stop 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 shutdown_connections 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f675c06f710 0x7f675c071bd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f677c15fa70 0x7f677c152260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f677c0cee70 0x7f677c151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 --2- 172.21.15.78:0/3079043431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f677c0cc090 0x7f677c14ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 >> 172.21.15.78:0/3079043431 conn(0x7f677c0cf7c0 msgr2=0x7f677c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 shutdown_connections 2024-09-10T11:52:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:19.666+0000 7f6782ed3640 1 -- 172.21.15.78:0/3079043431 wait complete. 2024-09-10T11:52:20.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:52:20.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:52:22.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 -- 172.21.15.78:0/3723403509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161630 msgr2=0x7fabb00d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 --2- 172.21.15.78:0/3723403509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161630 0x7fabb00d0540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabb00696a0 tx=0x7faba401c890 comp rx=0 tx=0).stop 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 -- 172.21.15.78:0/3723403509 shutdown_connections 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 --2- 172.21.15.78:0/3723403509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161630 0x7fabb00d0540 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 --2- 172.21.15.78:0/3723403509 >> v2:172.21.15.112:3300/0 conn(0x7fabb0161250 0x7fabb00d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 -- 172.21.15.78:0/3723403509 >> 172.21.15.78:0/3723403509 conn(0x7fabb00d3c80 msgr2=0x7fabb00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 -- 172.21.15.78:0/3723403509 shutdown_connections 2024-09-10T11:52:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.818+0000 7fabb576c640 1 -- 172.21.15.78:0/3723403509 wait complete. 2024-09-10T11:52:22.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 Processor -- start 2024-09-10T11:52:22.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- start start 2024-09-10T11:52:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 0x7fabb00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0161250 0x7fabb00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabb0161630 0x7fabb015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fabb016b1e0 con 0x7fabb00b4a10 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabb016b060 con 0x7fabb0161250 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fabb016b360 con 0x7fabb0161630 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 0x7fabb00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 0x7fabb00c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43916/0 (socket says 172.21.15.78:43916) 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 -- 172.21.15.78:0/27484442 learned_addr learned my addr 172.21.15.78:0/27484442 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabae7fc640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0161250 0x7fabb00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaf7fe640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabb0161630 0x7fabb015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 -- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabb0161630 msgr2=0x7fabb015cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabb0161630 0x7fabb015cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 -- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0161250 msgr2=0x7fabb00b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0161250 0x7fabb00b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 -- 172.21.15.78:0/27484442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb00ca7f0 con 0x7fabb00b4a10 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabaeffd640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 0x7fabb00c9ed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faba000c970 tx=0x7faba000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0007bb0 con 0x7fabb00b4a10 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba0005020 con 0x7fabb00b4a10 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01fae60 con 0x7fabb00b4a10 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0007e60 con 0x7fabb00b4a10 2024-09-10T11:52:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01fb420 con 0x7fabb00b4a10 2024-09-10T11:52:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.822+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb00d4770 con 0x7fabb00b4a10 2024-09-10T11:52:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.826+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7faba0005470 con 0x7fabb00b4a10 2024-09-10T11:52:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.826+0000 7fab977fe640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fab9c06f710 0x7fab9c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.826+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7faba0090110 con 0x7fabb00b4a10 2024-09-10T11:52:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.826+0000 7fabae7fc640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fab9c06f710 0x7fab9c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:22.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.826+0000 7fabae7fc640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fab9c06f710 0x7fab9c071bd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faba40af000 tx=0x7faba401b0d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:22.826+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7faba0014030 con 0x7fabb00b4a10 2024-09-10T11:52:23.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.010+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fabb00b5f90 con 0x7fabb00b4a10 2024-09-10T11:52:23.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.010+0000 7fab977fe640 1 -- 172.21.15.78:0/27484442 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7faba005d1a0 con 0x7fabb00b4a10 2024-09-10T11:52:23.013 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:23.014 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fab9c06f710 msgr2=0x7fab9c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fab9c06f710 0x7fab9c071bd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faba40af000 tx=0x7faba401b0d0 comp rx=0 tx=0).stop 2024-09-10T11:52:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 msgr2=0x7fabb00c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 0x7fabb00c9ed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faba000c970 tx=0x7faba000ce30 comp rx=0 tx=0).stop 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 shutdown_connections 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0161250 0x7fabb00b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fab9c06f710 0x7fab9c071bd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabb0161630 0x7fabb015cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 --2- 172.21.15.78:0/27484442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00b4a10 0x7fabb00c9ed0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 >> 172.21.15.78:0/27484442 conn(0x7fabb00d3c80 msgr2=0x7fabb00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 shutdown_connections 2024-09-10T11:52:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:23.014+0000 7fabb576c640 1 -- 172.21.15.78:0/27484442 wait complete. 2024-09-10T11:52:26.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:26.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2751518955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 msgr2=0x7f2d040cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:26.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2751518955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d040cfcd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009840 tx=0x7f2cf801c7e0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2751518955 shutdown_connections 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2751518955 >> v2:172.21.15.112:3300/0 conn(0x7f2d040708f0 0x7f2d04070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2751518955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d040cfcd0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2751518955 >> 172.21.15.78:0/2751518955 conn(0x7f2d040d19f0 msgr2=0x7f2d040d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2751518955 shutdown_connections 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2751518955 wait complete. 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 Processor -- start 2024-09-10T11:52:26.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- start start 2024-09-10T11:52:26.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d040708f0 0x7f2d041f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:26.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d0414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0406f5c0 0x7f2d04157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04168a80 con 0x7f2d040cf140 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04168900 con 0x7f2d0406f5c0 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2d04168c00 con 0x7f2d040708f0 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d0414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d0414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43920/0 (socket says 172.21.15.78:43920) 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 -- 172.21.15.78:0/2066873373 learned_addr learned my addr 172.21.15.78:0/2066873373 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d03fff640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d040708f0 0x7f2d041f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d08c4c640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0406f5c0 0x7f2d04157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 -- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d040708f0 msgr2=0x7f2d041f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d040708f0 0x7f2d041f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 -- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0406f5c0 msgr2=0x7f2d04157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0406f5c0 0x7f2d04157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 -- 172.21.15.78:0/2066873373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d04158570 con 0x7f2d040cf140 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d08c4c640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0406f5c0 0x7f2d04157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d037fe640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d0414e570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801ccc0 tx=0x7f2cf80a56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80b2040 con 0x7f2d040cf140 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf80bc070 con 0x7f2d040cf140 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d04158850 con 0x7f2d040cf140 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8003600 con 0x7f2d040cf140 2024-09-10T11:52:26.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.170+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d04158280 con 0x7f2d040cf140 2024-09-10T11:52:26.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.174+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d04070da0 con 0x7f2d040cf140 2024-09-10T11:52:26.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.174+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f2cf80037c0 con 0x7f2d040cf140 2024-09-10T11:52:26.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.174+0000 7f2d00ff9640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cf006f740 0x7f2cf0071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:26.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.174+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2cf8129f60 con 0x7f2d040cf140 2024-09-10T11:52:26.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.174+0000 7f2d03fff640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cf006f740 0x7f2cf0071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:26.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.174+0000 7f2d03fff640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cf006f740 0x7f2cf0071c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40012f0 tx=0x7f2cf4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:26.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.178+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f2cf80163d0 con 0x7f2d040cf140 2024-09-10T11:52:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2d040c7a70 con 0x7f2d040cf140 2024-09-10T11:52:26.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d00ff9640 1 -- 172.21.15.78:0/2066873373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f2cf80f6d70 con 0x7f2d040cf140 2024-09-10T11:52:26.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:26.355 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cf006f740 msgr2=0x7f2cf0071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cf006f740 0x7f2cf0071c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40012f0 tx=0x7f2cf4009040 comp rx=0 tx=0).stop 2024-09-10T11:52:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 msgr2=0x7f2d0414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d0414e570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801ccc0 tx=0x7f2cf80a56c0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 shutdown_connections 2024-09-10T11:52:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0406f5c0 0x7f2d04157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2cf006f740 0x7f2cf0071c00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d040cf140 0x7f2d0414e570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 --2- 172.21.15.78:0/2066873373 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d040708f0 0x7f2d041f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 >> 172.21.15.78:0/2066873373 conn(0x7f2d040d19f0 msgr2=0x7f2d040c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 shutdown_connections 2024-09-10T11:52:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:26.354+0000 7f2d0a6af640 1 -- 172.21.15.78:0/2066873373 wait complete. 2024-09-10T11:52:29.374 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 -- 172.21.15.78:0/2700652119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 msgr2=0x7f2120004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 --2- 172.21.15.78:0/2700652119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f2120004c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2124006fd0 tx=0x7f212401cf40 comp rx=0 tx=0).stop 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 -- 172.21.15.78:0/2700652119 shutdown_connections 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 --2- 172.21.15.78:0/2700652119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f2120004c90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 -- 172.21.15.78:0/2700652119 >> 172.21.15.78:0/2700652119 conn(0x7f21340cf7c0 msgr2=0x7f21340cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 -- 172.21.15.78:0/2700652119 shutdown_connections 2024-09-10T11:52:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.506+0000 7f213b35b640 1 -- 172.21.15.78:0/2700652119 wait complete. 2024-09-10T11:52:29.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 Processor -- start 2024-09-10T11:52:29.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- start start 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f21340adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2134072c90 0x7f2134073660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2134073ba0 0x7f21341f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f213415f9e0 con 0x7f2120004810 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f213415f860 con 0x7f2134072c90 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f213415fb60 con 0x7f2134073ba0 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f21340adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f21340adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43928/0 (socket says 172.21.15.78:43928) 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 -- 172.21.15.78:0/385718960 learned_addr learned my addr 172.21.15.78:0/385718960 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21388f6640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2134072c90 0x7f2134073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21398f8640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2134073ba0 0x7f21341f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:29.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 -- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2134073ba0 msgr2=0x7f21341f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2134073ba0 0x7f21341f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 -- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2134072c90 msgr2=0x7f2134073660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2134072c90 0x7f2134073660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 -- 172.21.15.78:0/385718960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21341f87f0 con 0x7f2120004810 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f21390f7640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f21340adb30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f213000d550 tx=0x7f213000da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130016020 con 0x7f2120004810 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2130012630 con 0x7f2120004810 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21340721b0 con 0x7f2120004810 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130012a20 con 0x7f2120004810 2024-09-10T11:52:29.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2134072770 con 0x7f2120004810 2024-09-10T11:52:29.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.510+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f213406e610 con 0x7f2120004810 2024-09-10T11:52:29.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.514+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f2130019020 con 0x7f2120004810 2024-09-10T11:52:29.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.514+0000 7f2129ffb640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f211806f740 0x7f2118071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:29.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.514+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f213008f5f0 con 0x7f2120004810 2024-09-10T11:52:29.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.514+0000 7f21388f6640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f211806f740 0x7f2118071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:29.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.514+0000 7f21388f6640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f211806f740 0x7f2118071c00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f21240ac000 tx=0x7f2124019d80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:29.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.518+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f2130020020 con 0x7f2120004810 2024-09-10T11:52:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21341504d0 con 0x7f2120004810 2024-09-10T11:52:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f2129ffb640 1 -- 172.21.15.78:0/385718960 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f213005c510 con 0x7f2120004810 2024-09-10T11:52:29.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:29.695 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f211806f740 msgr2=0x7f2118071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f211806f740 0x7f2118071c00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f21240ac000 tx=0x7f2124019d80 comp rx=0 tx=0).stop 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 msgr2=0x7f21340adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f21340adb30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f213000d550 tx=0x7f213000da10 comp rx=0 tx=0).stop 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 shutdown_connections 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2134072c90 0x7f2134073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f211806f740 0x7f2118071c00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2134073ba0 0x7f21341f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 --2- 172.21.15.78:0/385718960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2120004810 0x7f21340adb30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 >> 172.21.15.78:0/385718960 conn(0x7f21340cf7c0 msgr2=0x7f213414bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 shutdown_connections 2024-09-10T11:52:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:29.694+0000 7f213b35b640 1 -- 172.21.15.78:0/385718960 wait complete. 2024-09-10T11:52:32.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.846+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/1959139725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 msgr2=0x7fc5c00d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.846+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/1959139725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c00d4770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009900 tx=0x7fc5b001c8b0 comp rx=0 tx=0).stop 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/1959139725 shutdown_connections 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/1959139725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5c0161630 0x7fc5c00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/1959139725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c00d4770 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/1959139725 >> 172.21.15.78:0/1959139725 conn(0x7fc5c00d3c80 msgr2=0x7fc5c00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/1959139725 shutdown_connections 2024-09-10T11:52:32.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/1959139725 wait complete. 2024-09-10T11:52:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 Processor -- start 2024-09-10T11:52:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- start start 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c00b4a10 0x7fc5c0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5c0161630 0x7fc5c015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c016b1e0 con 0x7fc5c0161250 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c016b060 con 0x7fc5c00b4a10 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c016b360 con 0x7fc5c0161630 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c015c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33512/0 (socket says 172.21.15.78:33512) 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 -- 172.21.15.78:0/3294123087 learned_addr learned my addr 172.21.15.78:0/3294123087 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c4ada640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c00b4a10 0x7fc5c0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c52db640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5c0161630 0x7fc5c015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 -- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5c0161630 msgr2=0x7fc5c015cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5c0161630 0x7fc5c015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 -- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c00b4a10 msgr2=0x7fc5c0152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c00b4a10 0x7fc5c0152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 -- 172.21.15.78:0/3294123087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c01fb550 con 0x7fc5c0161250 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bffff640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c015c7d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c970 tx=0x7fc5b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4007bb0 con 0x7fc5c0161250 2024-09-10T11:52:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5b4005020 con 0x7fc5c0161250 2024-09-10T11:52:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c015d340 con 0x7fc5c0161250 2024-09-10T11:52:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4007e60 con 0x7fc5c0161250 2024-09-10T11:52:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.850+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c01fbad0 con 0x7fc5c0161250 2024-09-10T11:52:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.854+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c00d4770 con 0x7fc5c0161250 2024-09-10T11:52:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.854+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fc5b4005470 con 0x7fc5c0161250 2024-09-10T11:52:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.854+0000 7fc5bd7fa640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc5ac06f710 0x7fc5ac071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.854+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc5b40900c0 con 0x7fc5c0161250 2024-09-10T11:52:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.854+0000 7fc5c4ada640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc5ac06f710 0x7fc5ac071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.854+0000 7fc5c4ada640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc5ac06f710 0x7fc5ac071bd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00af000 tx=0x7fc5b001b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:32.858+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fc5b4014030 con 0x7fc5c0161250 2024-09-10T11:52:33.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5c00b07e0 con 0x7fc5c0161250 2024-09-10T11:52:33.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5bd7fa640 1 -- 172.21.15.78:0/3294123087 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc5b405d0c0 con 0x7fc5c0161250 2024-09-10T11:52:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:33.043 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:33.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc5ac06f710 msgr2=0x7fc5ac071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:33.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc5ac06f710 0x7fc5ac071bd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00af000 tx=0x7fc5b001b0f0 comp rx=0 tx=0).stop 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 msgr2=0x7fc5c015c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c015c7d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c970 tx=0x7fc5b400ce30 comp rx=0 tx=0).stop 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 shutdown_connections 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fc5ac06f710 0x7fc5ac071bd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5c0161630 0x7fc5c015cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c0161250 0x7fc5c015c7d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 --2- 172.21.15.78:0/3294123087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c00b4a10 0x7fc5c0152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 >> 172.21.15.78:0/3294123087 conn(0x7fc5c00d3c80 msgr2=0x7fc5c00b9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 shutdown_connections 2024-09-10T11:52:33.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:33.042+0000 7fc5c6d3e640 1 -- 172.21.15.78:0/3294123087 wait complete. 2024-09-10T11:52:36.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 -- 172.21.15.78:0/6986578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 msgr2=0x7fd92006ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 --2- 172.21.15.78:0/6986578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd92006ec40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd920070250 tx=0x7fd91801cc80 comp rx=0 tx=0).stop 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 -- 172.21.15.78:0/6986578 shutdown_connections 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 --2- 172.21.15.78:0/6986578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd92006ec40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 --2- 172.21.15.78:0/6986578 >> v2:172.21.15.112:3300/0 conn(0x7fd920159c30 0x7fd9200b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 -- 172.21.15.78:0/6986578 >> 172.21.15.78:0/6986578 conn(0x7fd9200cf7c0 msgr2=0x7fd9200cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 -- 172.21.15.78:0/6986578 shutdown_connections 2024-09-10T11:52:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 -- 172.21.15.78:0/6986578 wait complete. 2024-09-10T11:52:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 Processor -- start 2024-09-10T11:52:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.198+0000 7fd927546640 1 -- start start 2024-09-10T11:52:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd920154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd920159c30 0x7fd9200adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd92015a010 0x7fd9200b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd92006fcc0 con 0x7fd9200b3ce0 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd92006fb40 con 0x7fd920159c30 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd92006fe40 con 0x7fd92015a010 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd920154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd920154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33526/0 (socket says 172.21.15.78:33526) 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 -- 172.21.15.78:0/2023479831 learned_addr learned my addr 172.21.15.78:0/2023479831 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 -- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd92015a010 msgr2=0x7fd9200b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd92015a010 0x7fd9200b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 -- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd920159c30 msgr2=0x7fd9200adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd920159c30 0x7fd9200adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 -- 172.21.15.78:0/2023479831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9200b1f00 con 0x7fd9200b3ce0 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd9252e2640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd920154700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00dbd0 tx=0x7fd91c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c005220 con 0x7fd9200b3ce0 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd91c00ae50 con 0x7fd9200b3ce0 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9200b21e0 con 0x7fd9200b3ce0 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0047b0 con 0x7fd9200b3ce0 2024-09-10T11:52:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201541e0 con 0x7fd9200b3ce0 2024-09-10T11:52:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9201543e0 con 0x7fd9200b3ce0 2024-09-10T11:52:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fd91c004950 con 0x7fd9200b3ce0 2024-09-10T11:52:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd915ffb640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd90406f710 0x7fd904071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd91c08fe70 con 0x7fd9200b3ce0 2024-09-10T11:52:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.202+0000 7fd924ae1640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd90406f710 0x7fd904071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.206+0000 7fd924ae1640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd90406f710 0x7fd904071bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd920154fe0 tx=0x7fd9100079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.206+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fd9201543e0 con 0x7fd9200b3ce0 2024-09-10T11:52:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.378+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd92006ec40 con 0x7fd9200b3ce0 2024-09-10T11:52:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.378+0000 7fd915ffb640 1 -- 172.21.15.78:0/2023479831 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd91c05ce20 con 0x7fd9200b3ce0 2024-09-10T11:52:36.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:36.381 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd90406f710 msgr2=0x7fd904071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd90406f710 0x7fd904071bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd920154fe0 tx=0x7fd9100079c0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 msgr2=0x7fd920154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd920154700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00dbd0 tx=0x7fd91c00a620 comp rx=0 tx=0).stop 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 shutdown_connections 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd920159c30 0x7fd9200adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fd90406f710 0x7fd904071bd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd92015a010 0x7fd9200b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 --2- 172.21.15.78:0/2023479831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9200b3ce0 0x7fd920154700 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 >> 172.21.15.78:0/2023479831 conn(0x7fd9200cf7c0 msgr2=0x7fd92015a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 shutdown_connections 2024-09-10T11:52:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:36.382+0000 7fd927546640 1 -- 172.21.15.78:0/2023479831 wait complete. 2024-09-10T11:52:39.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:52:39.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/3993939754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa558159c30 msgr2=0x7fa5580b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/3993939754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa558159c30 0x7fa5580b2870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa548009900 tx=0x7fa54801c820 comp rx=0 tx=0).stop 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/3993939754 shutdown_connections 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/3993939754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5580b3ce0 0x7fa55806ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/3993939754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa558159c30 0x7fa5580b2870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/3993939754 >> 172.21.15.78:0/3993939754 conn(0x7fa5580cf7c0 msgr2=0x7fa5580cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/3993939754 shutdown_connections 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/3993939754 wait complete. 2024-09-10T11:52:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 Processor -- start 2024-09-10T11:52:39.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- start start 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 0x7fa55814e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa558159c30 0x7fa558158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55815a010 0x7fa558162eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa55806fc90 con 0x7fa5580b3ce0 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa55806fb10 con 0x7fa55815a010 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa55806fe10 con 0x7fa558159c30 2024-09-10T11:52:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 0x7fa55814e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 0x7fa55814e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33538/0 (socket says 172.21.15.78:33538) 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 -- 172.21.15.78:0/1296820651 learned_addr learned my addr 172.21.15.78:0/1296820651 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa556d9d640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55815a010 0x7fa558162eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa555d9b640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa558159c30 0x7fa558158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 -- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa558159c30 msgr2=0x7fa558158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa558159c30 0x7fa558158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 -- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55815a010 msgr2=0x7fa558162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55815a010 0x7fa558162eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 -- 172.21.15.78:0/1296820651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5581564c0 con 0x7fa5580b3ce0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa556d9d640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55815a010 0x7fa558162eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55659c640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 0x7fa55814e550 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa548009850 tx=0x7fa5480a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480b2040 con 0x7fa5580b3ce0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa548005070 con 0x7fa5580b3ce0 2024-09-10T11:52:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5581567a0 con 0x7fa5580b3ce0 2024-09-10T11:52:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480044f0 con 0x7fa5580b3ce0 2024-09-10T11:52:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.526+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5581fb310 con 0x7fa5580b3ce0 2024-09-10T11:52:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.530+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55806ec40 con 0x7fa5580b3ce0 2024-09-10T11:52:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.530+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fa5480bd060 con 0x7fa5580b3ce0 2024-09-10T11:52:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.530+0000 7fa54effd640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa53806f740 0x7fa538071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.530+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa548128cc0 con 0x7fa5580b3ce0 2024-09-10T11:52:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.530+0000 7fa555d9b640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa53806f740 0x7fa538071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.530+0000 7fa555d9b640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa53806f740 0x7fa538071c00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b1bd0 tx=0x7fa540009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:39.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.534+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fa5480164d0 con 0x7fa5580b3ce0 2024-09-10T11:52:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.710+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5580b4300 con 0x7fa5580b3ce0 2024-09-10T11:52:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa54effd640 1 -- 172.21.15.78:0/1296820651 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa5480f5bd0 con 0x7fa5580b3ce0 2024-09-10T11:52:39.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:39.714 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa53806f740 msgr2=0x7fa538071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa53806f740 0x7fa538071c00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b1bd0 tx=0x7fa540009040 comp rx=0 tx=0).stop 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 msgr2=0x7fa55814e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 0x7fa55814e550 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa548009850 tx=0x7fa5480a5770 comp rx=0 tx=0).stop 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 shutdown_connections 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55815a010 0x7fa558162eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fa53806f740 0x7fa538071c00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa558159c30 0x7fa558158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 --2- 172.21.15.78:0/1296820651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580b3ce0 0x7fa55814e550 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 >> 172.21.15.78:0/1296820651 conn(0x7fa5580cf7c0 msgr2=0x7fa558155890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 shutdown_connections 2024-09-10T11:52:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.714+0000 7fa55cbbb640 1 -- 172.21.15.78:0/1296820651 wait complete. 2024-09-10T11:52:39.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T11:52:39.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:52:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- 172.21.15.78:0/854812749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea006e8f0 msgr2=0x7f0ea00cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 --2- 172.21.15.78:0/854812749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea006e8f0 0x7f0ea00cdea0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00d0590 tx=0x7f0e9801cae0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- 172.21.15.78:0/854812749 shutdown_connections 2024-09-10T11:52:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 --2- 172.21.15.78:0/854812749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea006e8f0 0x7f0ea00cdea0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 --2- 172.21.15.78:0/854812749 >> v2:172.21.15.112:3300/0 conn(0x7f0ea01528c0 0x7f0ea00b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- 172.21.15.78:0/854812749 >> 172.21.15.78:0/854812749 conn(0x7f0ea00cf7c0 msgr2=0x7f0ea00cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- 172.21.15.78:0/854812749 shutdown_connections 2024-09-10T11:52:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- 172.21.15.78:0/854812749 wait complete. 2024-09-10T11:52:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 Processor -- start 2024-09-10T11:52:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- start start 2024-09-10T11:52:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea006e8f0 0x7f0ea014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00b54b0 0x7f0ea0154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 0x7f0ea0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0168660 con 0x7f0ea01528c0 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01684e0 con 0x7f0ea006e8f0 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0ea5729640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea01687e0 con 0x7f0ea00b54b0 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0e9f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 0x7f0ea0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0e9f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 0x7f0ea0157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33552/0 (socket says 172.21.15.78:33552) 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.854+0000 7f0e9f7fe640 1 -- 172.21.15.78:0/2294616011 learned_addr learned my addr 172.21.15.78:0/2294616011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e97fff640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00b54b0 0x7f0ea0154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9effd640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea006e8f0 0x7f0ea014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9f7fe640 1 -- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00b54b0 msgr2=0x7f0ea0154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9f7fe640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00b54b0 0x7f0ea0154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9f7fe640 1 -- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea006e8f0 msgr2=0x7f0ea014cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9f7fe640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea006e8f0 0x7f0ea014cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9f7fe640 1 -- 172.21.15.78:0/2294616011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea014d130 con 0x7f0ea01528c0 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e97fff640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00b54b0 0x7f0ea0154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9f7fe640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 0x7f0ea0157b10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0e9801b190 tx=0x7f0e980a5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980bb070 con 0x7f0ea01528c0 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e98004d40 con 0x7f0ea01528c0 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea0157770 con 0x7f0ea01528c0 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980b2040 con 0x7f0ea01528c0 2024-09-10T11:52:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea01571b0 con 0x7f0ea01528c0 2024-09-10T11:52:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea00cdea0 con 0x7f0ea01528c0 2024-09-10T11:52:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f0e980be070 con 0x7f0ea01528c0 2024-09-10T11:52:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e977fe640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0e8006f710 0x7f0e80071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0e98129670 con 0x7f0ea01528c0 2024-09-10T11:52:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.858+0000 7f0e9effd640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0e8006f710 0x7f0e80071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.862+0000 7f0e9effd640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0e8006f710 0x7f0e80071bd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005fd0 tx=0x7f0e90005d10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:39.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:39.862+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f0ea0152ca0 con 0x7f0ea01528c0 2024-09-10T11:52:40.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.006+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ea015b800 con 0x7f0e8006f710 2024-09-10T11:52:40.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.018+0000 7f0e977fe640 1 -- 172.21.15.78:0/2294616011 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251814 (secure 0 0 0) 0x7f0ea015b800 con 0x7f0e8006f710 2024-09-10T11:52:40.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0e8006f710 msgr2=0x7f0e80071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0e8006f710 0x7f0e80071bd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005fd0 tx=0x7f0e90005d10 comp rx=0 tx=0).stop 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 msgr2=0x7f0ea0157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 0x7f0ea0157b10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0e9801b190 tx=0x7f0e980a5ad0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 shutdown_connections 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f0e8006f710 0x7f0e80071bd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea01528c0 0x7f0ea0157b10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00b54b0 0x7f0ea0154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 --2- 172.21.15.78:0/2294616011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea006e8f0 0x7f0ea014cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 >> 172.21.15.78:0/2294616011 conn(0x7f0ea00cf7c0 msgr2=0x7f0ea0151180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 shutdown_connections 2024-09-10T11:52:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.022+0000 7f0ea5729640 1 -- 172.21.15.78:0/2294616011 wait complete. 2024-09-10T11:52:40.039 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-10T11:52:39.360189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223640,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751080,"statfs":{"total":773094113280,"available":772865105920,"internally_reserved":0,"allocated":3317760,"data_stored":1930740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005421"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434244+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:49:36.434244+0000","last_peered":"2024-09-10T11:49:36.434244+0000","last_clean":"2024-09-10T11:49:36.434244+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:49:36.434244+0000","last_undegraded":"2024-09-10T11:49:36.434244+0000","last_fullsized":"2024-09-10T11:49:36.434244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428368+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:49:36.428368+0000","last_peered":"2024-09-10T11:49:36.428368+0000","last_clean":"2024-09-10T11:49:36.428368+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:49:36.428368+0000","last_undegraded":"2024-09-10T11:49:36.428368+0000","last_fullsized":"2024-09-10T11:49:36.428368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428343+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:49:36.428343+0000","last_peered":"2024-09-10T11:49:36.428343+0000","last_clean":"2024-09-10T11:49:36.428343+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:49:36.428343+0000","last_undegraded":"2024-09-10T11:49:36.428343+0000","last_fullsized":"2024-09-10T11:49:36.428343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.431756+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:49:31.431756+0000","last_peered":"2024-09-10T11:49:31.431756+0000","last_clean":"2024-09-10T11:49:31.431756+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:49:31.431756+0000","last_undegraded":"2024-09-10T11:49:31.431756+0000","last_fullsized":"2024-09-10T11:49:31.431756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:48:11.416638+0000","last_change":"2024-09-10T11:48:08.362038+0000","last_active":"2024-09-10T11:48:11.416638+0000","last_peered":"2024-09-10T11:48:11.416638+0000","last_clean":"2024-09-10T11:48:11.416638+0000","last_became_active":"2024-09-10T11:48:08.361135+0000","last_became_peered":"2024-09-10T11:48:08.361135+0000","last_unstale":"2024-09-10T11:48:11.416638+0000","last_undegraded":"2024-09-10T11:48:11.416638+0000","last_fullsized":"2024-09-10T11:48:11.416638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:10.036485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437880+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:50:01.437880+0000","last_peered":"2024-09-10T11:50:01.437880+0000","last_clean":"2024-09-10T11:50:01.437880+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:50:01.437880+0000","last_undegraded":"2024-09-10T11:50:01.437880+0000","last_fullsized":"2024-09-10T11:50:01.437880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438586+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:50:01.438586+0000","last_peered":"2024-09-10T11:50:01.438586+0000","last_clean":"2024-09-10T11:50:01.438586+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:50:01.438586+0000","last_undegraded":"2024-09-10T11:50:01.438586+0000","last_fullsized":"2024-09-10T11:50:01.438586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.432667+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:50:01.432667+0000","last_peered":"2024-09-10T11:50:01.432667+0000","last_clean":"2024-09-10T11:50:01.432667+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:50:01.432667+0000","last_undegraded":"2024-09-10T11:50:01.432667+0000","last_fullsized":"2024-09-10T11:50:01.432667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436877+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:49:56.436877+0000","last_peered":"2024-09-10T11:49:56.436877+0000","last_clean":"2024-09-10T11:49:56.436877+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:49:56.436877+0000","last_undegraded":"2024-09-10T11:49:56.436877+0000","last_fullsized":"2024-09-10T11:49:56.436877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437733+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:49:56.437733+0000","last_peered":"2024-09-10T11:49:56.437733+0000","last_clean":"2024-09-10T11:49:56.437733+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:49:56.437733+0000","last_undegraded":"2024-09-10T11:49:56.437733+0000","last_fullsized":"2024-09-10T11:49:56.437733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437633+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:49:56.437633+0000","last_peered":"2024-09-10T11:49:56.437633+0000","last_clean":"2024-09-10T11:49:56.437633+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:49:56.437633+0000","last_undegraded":"2024-09-10T11:49:56.437633+0000","last_fullsized":"2024-09-10T11:49:56.437633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437534+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:49:56.437534+0000","last_peered":"2024-09-10T11:49:56.437534+0000","last_clean":"2024-09-10T11:49:56.437534+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:49:56.437534+0000","last_undegraded":"2024-09-10T11:49:56.437534+0000","last_fullsized":"2024-09-10T11:49:56.437534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430214+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:49:54.430214+0000","last_peered":"2024-09-10T11:49:54.430214+0000","last_clean":"2024-09-10T11:49:54.430214+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:49:54.430214+0000","last_undegraded":"2024-09-10T11:49:54.430214+0000","last_fullsized":"2024-09-10T11:49:54.430214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429349+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:49:49.429349+0000","last_peered":"2024-09-10T11:49:49.429349+0000","last_clean":"2024-09-10T11:49:49.429349+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:49:49.429349+0000","last_undegraded":"2024-09-10T11:49:49.429349+0000","last_fullsized":"2024-09-10T11:49:49.429349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.430994+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:49:51.430994+0000","last_peered":"2024-09-10T11:49:51.430994+0000","last_clean":"2024-09-10T11:49:51.430994+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:49:51.430994+0000","last_undegraded":"2024-09-10T11:49:51.430994+0000","last_fullsized":"2024-09-10T11:49:51.430994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438862+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:49:51.438862+0000","last_peered":"2024-09-10T11:49:51.438862+0000","last_clean":"2024-09-10T11:49:51.438862+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:49:51.438862+0000","last_undegraded":"2024-09-10T11:49:51.438862+0000","last_fullsized":"2024-09-10T11:49:51.438862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.439047+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:49:51.439047+0000","last_peered":"2024-09-10T11:49:51.439047+0000","last_clean":"2024-09-10T11:49:51.439047+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:49:51.439047+0000","last_undegraded":"2024-09-10T11:49:51.439047+0000","last_fullsized":"2024-09-10T11:49:51.439047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431703+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:49:51.431703+0000","last_peered":"2024-09-10T11:49:51.431703+0000","last_clean":"2024-09-10T11:49:51.431703+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:49:51.431703+0000","last_undegraded":"2024-09-10T11:49:51.431703+0000","last_fullsized":"2024-09-10T11:49:51.431703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438202+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:49:46.438202+0000","last_peered":"2024-09-10T11:49:46.438202+0000","last_clean":"2024-09-10T11:49:46.438202+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:49:46.438202+0000","last_undegraded":"2024-09-10T11:49:46.438202+0000","last_fullsized":"2024-09-10T11:49:46.438202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435797+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:49:46.435797+0000","last_peered":"2024-09-10T11:49:46.435797+0000","last_clean":"2024-09-10T11:49:46.435797+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:49:46.435797+0000","last_undegraded":"2024-09-10T11:49:46.435797+0000","last_fullsized":"2024-09-10T11:49:46.435797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436559+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:49:46.436559+0000","last_peered":"2024-09-10T11:49:46.436559+0000","last_clean":"2024-09-10T11:49:46.436559+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:49:46.436559+0000","last_undegraded":"2024-09-10T11:49:46.436559+0000","last_fullsized":"2024-09-10T11:49:46.436559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434727+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:49:46.434727+0000","last_peered":"2024-09-10T11:49:46.434727+0000","last_clean":"2024-09-10T11:49:46.434727+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:49:46.434727+0000","last_undegraded":"2024-09-10T11:49:46.434727+0000","last_fullsized":"2024-09-10T11:49:46.434727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430017+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:49:46.430017+0000","last_peered":"2024-09-10T11:49:46.430017+0000","last_clean":"2024-09-10T11:49:46.430017+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:49:46.430017+0000","last_undegraded":"2024-09-10T11:49:46.430017+0000","last_fullsized":"2024-09-10T11:49:46.430017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437160+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:49:41.437160+0000","last_peered":"2024-09-10T11:49:41.437160+0000","last_clean":"2024-09-10T11:49:41.437160+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:49:41.437160+0000","last_undegraded":"2024-09-10T11:49:41.437160+0000","last_fullsized":"2024-09-10T11:49:41.437160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429267+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:49:41.429267+0000","last_peered":"2024-09-10T11:49:41.429267+0000","last_clean":"2024-09-10T11:49:41.429267+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:49:41.429267+0000","last_undegraded":"2024-09-10T11:49:41.429267+0000","last_fullsized":"2024-09-10T11:49:41.429267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.433795+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:49:41.433795+0000","last_peered":"2024-09-10T11:49:41.433795+0000","last_clean":"2024-09-10T11:49:41.433795+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:49:41.433795+0000","last_undegraded":"2024-09-10T11:49:41.433795+0000","last_fullsized":"2024-09-10T11:49:41.433795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427797+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:49:39.427797+0000","last_peered":"2024-09-10T11:49:39.427797+0000","last_clean":"2024-09-10T11:49:39.427797+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:49:39.427797+0000","last_undegraded":"2024-09-10T11:49:39.427797+0000","last_fullsized":"2024-09-10T11:49:39.427797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427772+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:49:39.427772+0000","last_peered":"2024-09-10T11:49:39.427772+0000","last_clean":"2024-09-10T11:49:39.427772+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:49:39.427772+0000","last_undegraded":"2024-09-10T11:49:39.427772+0000","last_fullsized":"2024-09-10T11:49:39.427772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428301+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:49:36.428301+0000","last_peered":"2024-09-10T11:49:36.428301+0000","last_clean":"2024-09-10T11:49:36.428301+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:49:36.428301+0000","last_undegraded":"2024-09-10T11:49:36.428301+0000","last_fullsized":"2024-09-10T11:49:36.428301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436262+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:49:36.436262+0000","last_peered":"2024-09-10T11:49:36.436262+0000","last_clean":"2024-09-10T11:49:36.436262+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:49:36.436262+0000","last_undegraded":"2024-09-10T11:49:36.436262+0000","last_fullsized":"2024-09-10T11:49:36.436262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.429212+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:49:36.429212+0000","last_peered":"2024-09-10T11:49:36.429212+0000","last_clean":"2024-09-10T11:49:36.429212+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:49:36.429212+0000","last_undegraded":"2024-09-10T11:49:36.429212+0000","last_fullsized":"2024-09-10T11:49:36.429212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432744+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:49:36.432744+0000","last_peered":"2024-09-10T11:49:36.432744+0000","last_clean":"2024-09-10T11:49:36.432744+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:49:36.432744+0000","last_undegraded":"2024-09-10T11:49:36.432744+0000","last_fullsized":"2024-09-10T11:49:36.432744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437881+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:50:01.437881+0000","last_peered":"2024-09-10T11:50:01.437881+0000","last_clean":"2024-09-10T11:50:01.437881+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:50:01.437881+0000","last_undegraded":"2024-09-10T11:50:01.437881+0000","last_fullsized":"2024-09-10T11:50:01.437881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431860+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:49:56.431860+0000","last_peered":"2024-09-10T11:49:56.431860+0000","last_clean":"2024-09-10T11:49:56.431860+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:49:56.431860+0000","last_undegraded":"2024-09-10T11:49:56.431860+0000","last_fullsized":"2024-09-10T11:49:56.431860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438909+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:50:01.438909+0000","last_peered":"2024-09-10T11:50:01.438909+0000","last_clean":"2024-09-10T11:50:01.438909+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:50:01.438909+0000","last_undegraded":"2024-09-10T11:50:01.438909+0000","last_fullsized":"2024-09-10T11:50:01.438909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.439795+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:49:56.439795+0000","last_peered":"2024-09-10T11:49:56.439795+0000","last_clean":"2024-09-10T11:49:56.439795+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:49:56.439795+0000","last_undegraded":"2024-09-10T11:49:56.439795+0000","last_fullsized":"2024-09-10T11:49:56.439795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430158+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:49:54.430158+0000","last_peered":"2024-09-10T11:49:54.430158+0000","last_clean":"2024-09-10T11:49:54.430158+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:49:54.430158+0000","last_undegraded":"2024-09-10T11:49:54.430158+0000","last_fullsized":"2024-09-10T11:49:54.430158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431811+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:49:56.431811+0000","last_peered":"2024-09-10T11:49:56.431811+0000","last_clean":"2024-09-10T11:49:56.431811+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:49:56.431811+0000","last_undegraded":"2024-09-10T11:49:56.431811+0000","last_fullsized":"2024-09-10T11:49:56.431811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438899+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:49:51.438899+0000","last_peered":"2024-09-10T11:49:51.438899+0000","last_clean":"2024-09-10T11:49:51.438899+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:49:51.438899+0000","last_undegraded":"2024-09-10T11:49:51.438899+0000","last_fullsized":"2024-09-10T11:49:51.438899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.438050+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:49:56.438050+0000","last_peered":"2024-09-10T11:49:56.438050+0000","last_clean":"2024-09-10T11:49:56.438050+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:49:56.438050+0000","last_undegraded":"2024-09-10T11:49:56.438050+0000","last_fullsized":"2024-09-10T11:49:56.438050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435922+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:49:51.435922+0000","last_peered":"2024-09-10T11:49:51.435922+0000","last_clean":"2024-09-10T11:49:51.435922+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:49:51.435922+0000","last_undegraded":"2024-09-10T11:49:51.435922+0000","last_fullsized":"2024-09-10T11:49:51.435922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436869+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:49:56.436869+0000","last_peered":"2024-09-10T11:49:56.436869+0000","last_clean":"2024-09-10T11:49:56.436869+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:49:56.436869+0000","last_undegraded":"2024-09-10T11:49:56.436869+0000","last_fullsized":"2024-09-10T11:49:56.436869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.436613+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:49:51.436613+0000","last_peered":"2024-09-10T11:49:51.436613+0000","last_clean":"2024-09-10T11:49:51.436613+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:49:51.436613+0000","last_undegraded":"2024-09-10T11:49:51.436613+0000","last_fullsized":"2024-09-10T11:49:51.436613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431909+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:49:56.431909+0000","last_peered":"2024-09-10T11:49:56.431909+0000","last_clean":"2024-09-10T11:49:56.431909+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:49:56.431909+0000","last_undegraded":"2024-09-10T11:49:56.431909+0000","last_fullsized":"2024-09-10T11:49:56.431909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431666+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:49:51.431666+0000","last_peered":"2024-09-10T11:49:51.431666+0000","last_clean":"2024-09-10T11:49:51.431666+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:49:51.431666+0000","last_undegraded":"2024-09-10T11:49:51.431666+0000","last_fullsized":"2024-09-10T11:49:51.431666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438994+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:49:51.438994+0000","last_peered":"2024-09-10T11:49:51.438994+0000","last_clean":"2024-09-10T11:49:51.438994+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:49:51.438994+0000","last_undegraded":"2024-09-10T11:49:51.438994+0000","last_fullsized":"2024-09-10T11:49:51.438994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434743+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:49:46.434743+0000","last_peered":"2024-09-10T11:49:46.434743+0000","last_clean":"2024-09-10T11:49:46.434743+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:49:46.434743+0000","last_undegraded":"2024-09-10T11:49:46.434743+0000","last_fullsized":"2024-09-10T11:49:46.434743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437662+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:49:56.437662+0000","last_peered":"2024-09-10T11:49:56.437662+0000","last_clean":"2024-09-10T11:49:56.437662+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:49:56.437662+0000","last_undegraded":"2024-09-10T11:49:56.437662+0000","last_fullsized":"2024-09-10T11:49:56.437662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430815+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:49:46.430815+0000","last_peered":"2024-09-10T11:49:46.430815+0000","last_clean":"2024-09-10T11:49:46.430815+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:49:46.430815+0000","last_undegraded":"2024-09-10T11:49:46.430815+0000","last_fullsized":"2024-09-10T11:49:46.430815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429393+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:49:49.429393+0000","last_peered":"2024-09-10T11:49:49.429393+0000","last_clean":"2024-09-10T11:49:49.429393+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:49:49.429393+0000","last_undegraded":"2024-09-10T11:49:49.429393+0000","last_fullsized":"2024-09-10T11:49:49.429393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438128+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:49:46.438128+0000","last_peered":"2024-09-10T11:49:46.438128+0000","last_clean":"2024-09-10T11:49:46.438128+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:49:46.438128+0000","last_undegraded":"2024-09-10T11:49:46.438128+0000","last_fullsized":"2024-09-10T11:49:46.438128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438966+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:49:51.438966+0000","last_peered":"2024-09-10T11:49:51.438966+0000","last_clean":"2024-09-10T11:49:51.438966+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:49:51.438966+0000","last_undegraded":"2024-09-10T11:49:51.438966+0000","last_fullsized":"2024-09-10T11:49:51.438966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435759+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:49:46.435759+0000","last_peered":"2024-09-10T11:49:46.435759+0000","last_clean":"2024-09-10T11:49:46.435759+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:49:46.435759+0000","last_undegraded":"2024-09-10T11:49:46.435759+0000","last_fullsized":"2024-09-10T11:49:46.435759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435809+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:49:51.435809+0000","last_peered":"2024-09-10T11:49:51.435809+0000","last_clean":"2024-09-10T11:49:51.435809+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:49:51.435809+0000","last_undegraded":"2024-09-10T11:49:51.435809+0000","last_fullsized":"2024-09-10T11:49:51.435809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436510+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:49:46.436510+0000","last_peered":"2024-09-10T11:49:46.436510+0000","last_clean":"2024-09-10T11:49:46.436510+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:49:46.436510+0000","last_undegraded":"2024-09-10T11:49:46.436510+0000","last_fullsized":"2024-09-10T11:49:46.436510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438925+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:49:51.438925+0000","last_peered":"2024-09-10T11:49:51.438925+0000","last_clean":"2024-09-10T11:49:51.438925+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:49:51.438925+0000","last_undegraded":"2024-09-10T11:49:51.438925+0000","last_fullsized":"2024-09-10T11:49:51.438925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435056+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:49:41.435056+0000","last_peered":"2024-09-10T11:49:41.435056+0000","last_clean":"2024-09-10T11:49:41.435056+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:49:41.435056+0000","last_undegraded":"2024-09-10T11:49:41.435056+0000","last_fullsized":"2024-09-10T11:49:41.435056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434831+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:49:46.434831+0000","last_peered":"2024-09-10T11:49:46.434831+0000","last_clean":"2024-09-10T11:49:46.434831+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:49:46.434831+0000","last_undegraded":"2024-09-10T11:49:46.434831+0000","last_fullsized":"2024-09-10T11:49:46.434831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435747+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:49:41.435747+0000","last_peered":"2024-09-10T11:49:41.435747+0000","last_clean":"2024-09-10T11:49:41.435747+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:49:41.435747+0000","last_undegraded":"2024-09-10T11:49:41.435747+0000","last_fullsized":"2024-09-10T11:49:41.435747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435859+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:49:46.435859+0000","last_peered":"2024-09-10T11:49:46.435859+0000","last_clean":"2024-09-10T11:49:46.435859+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:49:46.435859+0000","last_undegraded":"2024-09-10T11:49:46.435859+0000","last_fullsized":"2024-09-10T11:49:46.435859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429216+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:49:41.429216+0000","last_peered":"2024-09-10T11:49:41.429216+0000","last_clean":"2024-09-10T11:49:41.429216+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:49:41.429216+0000","last_undegraded":"2024-09-10T11:49:41.429216+0000","last_fullsized":"2024-09-10T11:49:41.429216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435817+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:49:46.435817+0000","last_peered":"2024-09-10T11:49:46.435817+0000","last_clean":"2024-09-10T11:49:46.435817+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:49:46.435817+0000","last_undegraded":"2024-09-10T11:49:46.435817+0000","last_fullsized":"2024-09-10T11:49:46.435817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:44.428573+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:49:44.428573+0000","last_peered":"2024-09-10T11:49:44.428573+0000","last_clean":"2024-09-10T11:49:44.428573+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:49:44.428573+0000","last_undegraded":"2024-09-10T11:49:44.428573+0000","last_fullsized":"2024-09-10T11:49:44.428573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438182+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:49:46.438182+0000","last_peered":"2024-09-10T11:49:46.438182+0000","last_clean":"2024-09-10T11:49:46.438182+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:49:46.438182+0000","last_undegraded":"2024-09-10T11:49:46.438182+0000","last_fullsized":"2024-09-10T11:49:46.438182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:21.429807+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:49:21.429807+0000","last_peered":"2024-09-10T11:49:21.429807+0000","last_clean":"2024-09-10T11:49:21.429807+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:49:21.429807+0000","last_undegraded":"2024-09-10T11:49:21.429807+0000","last_fullsized":"2024-09-10T11:49:21.429807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435419+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:49:31.435419+0000","last_peered":"2024-09-10T11:49:31.435419+0000","last_clean":"2024-09-10T11:49:31.435419+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:49:31.435419+0000","last_undegraded":"2024-09-10T11:49:31.435419+0000","last_fullsized":"2024-09-10T11:49:31.435419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434760+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:49:36.434760+0000","last_peered":"2024-09-10T11:49:36.434760+0000","last_clean":"2024-09-10T11:49:36.434760+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:49:36.434760+0000","last_undegraded":"2024-09-10T11:49:36.434760+0000","last_fullsized":"2024-09-10T11:49:36.434760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.434506+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:49:26.434506+0000","last_peered":"2024-09-10T11:49:26.434506+0000","last_clean":"2024-09-10T11:49:26.434506+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:49:26.434506+0000","last_undegraded":"2024-09-10T11:49:26.434506+0000","last_fullsized":"2024-09-10T11:49:26.434506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426883+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:49:34.426883+0000","last_peered":"2024-09-10T11:49:34.426883+0000","last_clean":"2024-09-10T11:49:34.426883+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:49:34.426883+0000","last_undegraded":"2024-09-10T11:49:34.426883+0000","last_fullsized":"2024-09-10T11:49:34.426883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.428445+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:49:31.428445+0000","last_peered":"2024-09-10T11:49:31.428445+0000","last_clean":"2024-09-10T11:49:31.428445+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:49:31.428445+0000","last_undegraded":"2024-09-10T11:49:31.428445+0000","last_fullsized":"2024-09-10T11:49:31.428445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427438+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:49:31.427438+0000","last_peered":"2024-09-10T11:49:31.427438+0000","last_clean":"2024-09-10T11:49:31.427438+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:49:31.427438+0000","last_undegraded":"2024-09-10T11:49:31.427438+0000","last_fullsized":"2024-09-10T11:49:31.427438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435377+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:49:31.435377+0000","last_peered":"2024-09-10T11:49:31.435377+0000","last_clean":"2024-09-10T11:49:31.435377+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:49:31.435377+0000","last_undegraded":"2024-09-10T11:49:31.435377+0000","last_fullsized":"2024-09-10T11:49:31.435377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434189+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:49:36.434189+0000","last_peered":"2024-09-10T11:49:36.434189+0000","last_clean":"2024-09-10T11:49:36.434189+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:49:36.434189+0000","last_undegraded":"2024-09-10T11:49:36.434189+0000","last_fullsized":"2024-09-10T11:49:36.434189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427490+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:49:31.427490+0000","last_peered":"2024-09-10T11:49:31.427490+0000","last_clean":"2024-09-10T11:49:31.427490+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:49:31.427490+0000","last_undegraded":"2024-09-10T11:49:31.427490+0000","last_fullsized":"2024-09-10T11:49:31.427490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432822+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:49:36.432822+0000","last_peered":"2024-09-10T11:49:36.432822+0000","last_clean":"2024-09-10T11:49:36.432822+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:49:36.432822+0000","last_undegraded":"2024-09-10T11:49:36.432822+0000","last_fullsized":"2024-09-10T11:49:36.432822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435448+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:49:31.435448+0000","last_peered":"2024-09-10T11:49:31.435448+0000","last_clean":"2024-09-10T11:49:31.435448+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:49:31.435448+0000","last_undegraded":"2024-09-10T11:49:31.435448+0000","last_fullsized":"2024-09-10T11:49:31.435448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426945+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:49:34.426945+0000","last_peered":"2024-09-10T11:49:34.426945+0000","last_clean":"2024-09-10T11:49:34.426945+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:49:34.426945+0000","last_undegraded":"2024-09-10T11:49:34.426945+0000","last_fullsized":"2024-09-10T11:49:34.426945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434806+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:49:36.434806+0000","last_peered":"2024-09-10T11:49:36.434806+0000","last_clean":"2024-09-10T11:49:36.434806+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:49:36.434806+0000","last_undegraded":"2024-09-10T11:49:36.434806+0000","last_fullsized":"2024-09-10T11:49:36.434806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435792+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:49:41.435792+0000","last_peered":"2024-09-10T11:49:41.435792+0000","last_clean":"2024-09-10T11:49:41.435792+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:49:41.435792+0000","last_undegraded":"2024-09-10T11:49:41.435792+0000","last_fullsized":"2024-09-10T11:49:41.435792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436374+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:49:36.436374+0000","last_peered":"2024-09-10T11:49:36.436374+0000","last_clean":"2024-09-10T11:49:36.436374+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:49:36.436374+0000","last_undegraded":"2024-09-10T11:49:36.436374+0000","last_fullsized":"2024-09-10T11:49:36.436374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435715+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:49:41.435715+0000","last_peered":"2024-09-10T11:49:41.435715+0000","last_clean":"2024-09-10T11:49:41.435715+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:49:41.435715+0000","last_undegraded":"2024-09-10T11:49:41.435715+0000","last_fullsized":"2024-09-10T11:49:41.435715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434146+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:49:36.434146+0000","last_peered":"2024-09-10T11:49:36.434146+0000","last_clean":"2024-09-10T11:49:36.434146+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:49:36.434146+0000","last_undegraded":"2024-09-10T11:49:36.434146+0000","last_fullsized":"2024-09-10T11:49:36.434146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437230+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:49:41.437230+0000","last_peered":"2024-09-10T11:49:41.437230+0000","last_clean":"2024-09-10T11:49:41.437230+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:49:41.437230+0000","last_undegraded":"2024-09-10T11:49:41.437230+0000","last_fullsized":"2024-09-10T11:49:41.437230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434724+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:49:36.434724+0000","last_peered":"2024-09-10T11:49:36.434724+0000","last_clean":"2024-09-10T11:49:36.434724+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:49:36.434724+0000","last_undegraded":"2024-09-10T11:49:36.434724+0000","last_fullsized":"2024-09-10T11:49:36.434724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435652+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:49:41.435652+0000","last_peered":"2024-09-10T11:49:41.435652+0000","last_clean":"2024-09-10T11:49:41.435652+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:49:41.435652+0000","last_undegraded":"2024-09-10T11:49:41.435652+0000","last_fullsized":"2024-09-10T11:49:41.435652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427732+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:49:39.427732+0000","last_peered":"2024-09-10T11:49:39.427732+0000","last_clean":"2024-09-10T11:49:39.427732+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:49:39.427732+0000","last_undegraded":"2024-09-10T11:49:39.427732+0000","last_fullsized":"2024-09-10T11:49:39.427732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430777+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:49:46.430777+0000","last_peered":"2024-09-10T11:49:46.430777+0000","last_clean":"2024-09-10T11:49:46.430777+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:49:46.430777+0000","last_undegraded":"2024-09-10T11:49:46.430777+0000","last_fullsized":"2024-09-10T11:49:46.430777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437325+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:49:41.437325+0000","last_peered":"2024-09-10T11:49:41.437325+0000","last_clean":"2024-09-10T11:49:41.437325+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:49:41.437325+0000","last_undegraded":"2024-09-10T11:49:41.437325+0000","last_fullsized":"2024-09-10T11:49:41.437325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437268+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:49:41.437268+0000","last_peered":"2024-09-10T11:49:41.437268+0000","last_clean":"2024-09-10T11:49:41.437268+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:49:41.437268+0000","last_undegraded":"2024-09-10T11:49:41.437268+0000","last_fullsized":"2024-09-10T11:49:41.437268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.440585+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:50:01.440585+0000","last_peered":"2024-09-10T11:50:01.440585+0000","last_clean":"2024-09-10T11:50:01.440585+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:50:01.440585+0000","last_undegraded":"2024-09-10T11:50:01.440585+0000","last_fullsized":"2024-09-10T11:50:01.440585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437593+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:49:56.437593+0000","last_peered":"2024-09-10T11:49:56.437593+0000","last_clean":"2024-09-10T11:49:56.437593+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:49:56.437593+0000","last_undegraded":"2024-09-10T11:49:56.437593+0000","last_fullsized":"2024-09-10T11:49:56.437593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437936+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:50:01.437936+0000","last_peered":"2024-09-10T11:50:01.437936+0000","last_clean":"2024-09-10T11:50:01.437936+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:50:01.437936+0000","last_undegraded":"2024-09-10T11:50:01.437936+0000","last_fullsized":"2024-09-10T11:50:01.437936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437692+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:49:56.437692+0000","last_peered":"2024-09-10T11:49:56.437692+0000","last_clean":"2024-09-10T11:49:56.437692+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:49:56.437692+0000","last_undegraded":"2024-09-10T11:49:56.437692+0000","last_fullsized":"2024-09-10T11:49:56.437692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428397+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:49:36.428397+0000","last_peered":"2024-09-10T11:49:36.428397+0000","last_clean":"2024-09-10T11:49:36.428397+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:49:36.428397+0000","last_undegraded":"2024-09-10T11:49:36.428397+0000","last_fullsized":"2024-09-10T11:49:36.428397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.426657+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:49:26.426657+0000","last_peered":"2024-09-10T11:49:26.426657+0000","last_clean":"2024-09-10T11:49:26.426657+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:49:26.426657+0000","last_undegraded":"2024-09-10T11:49:26.426657+0000","last_fullsized":"2024-09-10T11:49:26.426657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427539+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:49:31.427539+0000","last_peered":"2024-09-10T11:49:31.427539+0000","last_clean":"2024-09-10T11:49:31.427539+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:49:31.427539+0000","last_undegraded":"2024-09-10T11:49:31.427539+0000","last_fullsized":"2024-09-10T11:49:31.427539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.433884+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:49:31.433884+0000","last_peered":"2024-09-10T11:49:31.433884+0000","last_clean":"2024-09-10T11:49:31.433884+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:49:31.433884+0000","last_undegraded":"2024-09-10T11:49:31.433884+0000","last_fullsized":"2024-09-10T11:49:31.433884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":93272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":683608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":95432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":94760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":93148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:52:40.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:52:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/2560238376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 msgr2=0x7fb87406ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 --2- 172.21.15.78:0/2560238376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87406ec40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb874074600 tx=0x7fb86c01cce0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/2560238376 shutdown_connections 2024-09-10T11:52:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 --2- 172.21.15.78:0/2560238376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87406ec40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 --2- 172.21.15.78:0/2560238376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8740b3ce0 0x7fb8740b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/2560238376 >> 172.21.15.78:0/2560238376 conn(0x7fb8740cf7c0 msgr2=0x7fb8740cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/2560238376 shutdown_connections 2024-09-10T11:52:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/2560238376 wait complete. 2024-09-10T11:52:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 Processor -- start 2024-09-10T11:52:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- start start 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8740b3ce0 0x7fb8741f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb874159c30 0x7fb87414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb87406fd10 con 0x7fb87415a010 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb87406fb90 con 0x7fb874159c30 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb87406fe90 con 0x7fb8740b3ce0 2024-09-10T11:52:40.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87414eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37608/0 (socket says 172.21.15.78:37608) 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 -- 172.21.15.78:0/1035855886 learned_addr learned my addr 172.21.15.78:0/1035855886 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb86bfff640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb874159c30 0x7fb87414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb8737fe640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8740b3ce0 0x7fb8741f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 -- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8740b3ce0 msgr2=0x7fb8741f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8740b3ce0 0x7fb8741f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 -- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb874159c30 msgr2=0x7fb87414ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb874159c30 0x7fb87414ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 -- 172.21.15.78:0/1035855886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb874150c20 con 0x7fb87415a010 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb873fff640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87414eeb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb86c01d580 tx=0x7fb86c005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0b2040 con 0x7fb87415a010 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb86c004040 con 0x7fb87415a010 2024-09-10T11:52:40.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb874150f00 con 0x7fb87415a010 2024-09-10T11:52:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c004450 con 0x7fb87415a010 2024-09-10T11:52:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.206+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8741514c0 con 0x7fb87415a010 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.210+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8740b2870 con 0x7fb87415a010 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.210+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb86c0045f0 con 0x7fb87415a010 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.210+0000 7fb870ff9640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb85406f710 0x7fb854071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.210+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb86c129e80 con 0x7fb87415a010 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.210+0000 7fb8737fe640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb85406f710 0x7fb854071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.210+0000 7fb8737fe640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb85406f710 0x7fb854071bd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb864004e30 tx=0x7fb864009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.214+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb86c016990 con 0x7fb87415a010 2024-09-10T11:52:40.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.346+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb874151690 con 0x7fb85406f710 2024-09-10T11:52:40.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb870ff9640 1 -- 172.21.15.78:0/1035855886 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251814 (secure 0 0 0) 0x7fb874151690 con 0x7fb85406f710 2024-09-10T11:52:40.360 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:40.361 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:52:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb85406f710 msgr2=0x7fb854071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb85406f710 0x7fb854071bd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb864004e30 tx=0x7fb864009040 comp rx=0 tx=0).stop 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 msgr2=0x7fb87414eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87414eeb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb86c01d580 tx=0x7fb86c005ae0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 shutdown_connections 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb874159c30 0x7fb87414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb85406f710 0x7fb854071bd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87415a010 0x7fb87414eeb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 --2- 172.21.15.78:0/1035855886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8740b3ce0 0x7fb8741f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.358+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 >> 172.21.15.78:0/1035855886 conn(0x7fb8740cf7c0 msgr2=0x7fb8740cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.362+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 shutdown_connections 2024-09-10T11:52:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.362+0000 7fb879c2e640 1 -- 172.21.15.78:0/1035855886 wait complete. 2024-09-10T11:52:40.376 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-10T11:52:39.360189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223640,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751080,"statfs":{"total":773094113280,"available":772865105920,"internally_reserved":0,"allocated":3317760,"data_stored":1930740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005421"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434244+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:49:36.434244+0000","last_peered":"2024-09-10T11:49:36.434244+0000","last_clean":"2024-09-10T11:49:36.434244+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:49:36.434244+0000","last_undegraded":"2024-09-10T11:49:36.434244+0000","last_fullsized":"2024-09-10T11:49:36.434244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428368+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:49:36.428368+0000","last_peered":"2024-09-10T11:49:36.428368+0000","last_clean":"2024-09-10T11:49:36.428368+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:49:36.428368+0000","last_undegraded":"2024-09-10T11:49:36.428368+0000","last_fullsized":"2024-09-10T11:49:36.428368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428343+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:49:36.428343+0000","last_peered":"2024-09-10T11:49:36.428343+0000","last_clean":"2024-09-10T11:49:36.428343+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:49:36.428343+0000","last_undegraded":"2024-09-10T11:49:36.428343+0000","last_fullsized":"2024-09-10T11:49:36.428343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.431756+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:49:31.431756+0000","last_peered":"2024-09-10T11:49:31.431756+0000","last_clean":"2024-09-10T11:49:31.431756+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:49:31.431756+0000","last_undegraded":"2024-09-10T11:49:31.431756+0000","last_fullsized":"2024-09-10T11:49:31.431756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:48:11.416638+0000","last_change":"2024-09-10T11:48:08.362038+0000","last_active":"2024-09-10T11:48:11.416638+0000","last_peered":"2024-09-10T11:48:11.416638+0000","last_clean":"2024-09-10T11:48:11.416638+0000","last_became_active":"2024-09-10T11:48:08.361135+0000","last_became_peered":"2024-09-10T11:48:08.361135+0000","last_unstale":"2024-09-10T11:48:11.416638+0000","last_undegraded":"2024-09-10T11:48:11.416638+0000","last_fullsized":"2024-09-10T11:48:11.416638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:10.036485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437880+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:50:01.437880+0000","last_peered":"2024-09-10T11:50:01.437880+0000","last_clean":"2024-09-10T11:50:01.437880+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:50:01.437880+0000","last_undegraded":"2024-09-10T11:50:01.437880+0000","last_fullsized":"2024-09-10T11:50:01.437880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438586+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:50:01.438586+0000","last_peered":"2024-09-10T11:50:01.438586+0000","last_clean":"2024-09-10T11:50:01.438586+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:50:01.438586+0000","last_undegraded":"2024-09-10T11:50:01.438586+0000","last_fullsized":"2024-09-10T11:50:01.438586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.432667+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:50:01.432667+0000","last_peered":"2024-09-10T11:50:01.432667+0000","last_clean":"2024-09-10T11:50:01.432667+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:50:01.432667+0000","last_undegraded":"2024-09-10T11:50:01.432667+0000","last_fullsized":"2024-09-10T11:50:01.432667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436877+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:49:56.436877+0000","last_peered":"2024-09-10T11:49:56.436877+0000","last_clean":"2024-09-10T11:49:56.436877+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:49:56.436877+0000","last_undegraded":"2024-09-10T11:49:56.436877+0000","last_fullsized":"2024-09-10T11:49:56.436877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437733+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:49:56.437733+0000","last_peered":"2024-09-10T11:49:56.437733+0000","last_clean":"2024-09-10T11:49:56.437733+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:49:56.437733+0000","last_undegraded":"2024-09-10T11:49:56.437733+0000","last_fullsized":"2024-09-10T11:49:56.437733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437633+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:49:56.437633+0000","last_peered":"2024-09-10T11:49:56.437633+0000","last_clean":"2024-09-10T11:49:56.437633+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:49:56.437633+0000","last_undegraded":"2024-09-10T11:49:56.437633+0000","last_fullsized":"2024-09-10T11:49:56.437633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437534+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:49:56.437534+0000","last_peered":"2024-09-10T11:49:56.437534+0000","last_clean":"2024-09-10T11:49:56.437534+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:49:56.437534+0000","last_undegraded":"2024-09-10T11:49:56.437534+0000","last_fullsized":"2024-09-10T11:49:56.437534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430214+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:49:54.430214+0000","last_peered":"2024-09-10T11:49:54.430214+0000","last_clean":"2024-09-10T11:49:54.430214+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:49:54.430214+0000","last_undegraded":"2024-09-10T11:49:54.430214+0000","last_fullsized":"2024-09-10T11:49:54.430214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429349+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:49:49.429349+0000","last_peered":"2024-09-10T11:49:49.429349+0000","last_clean":"2024-09-10T11:49:49.429349+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:49:49.429349+0000","last_undegraded":"2024-09-10T11:49:49.429349+0000","last_fullsized":"2024-09-10T11:49:49.429349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.430994+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:49:51.430994+0000","last_peered":"2024-09-10T11:49:51.430994+0000","last_clean":"2024-09-10T11:49:51.430994+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:49:51.430994+0000","last_undegraded":"2024-09-10T11:49:51.430994+0000","last_fullsized":"2024-09-10T11:49:51.430994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438862+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:49:51.438862+0000","last_peered":"2024-09-10T11:49:51.438862+0000","last_clean":"2024-09-10T11:49:51.438862+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:49:51.438862+0000","last_undegraded":"2024-09-10T11:49:51.438862+0000","last_fullsized":"2024-09-10T11:49:51.438862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.439047+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:49:51.439047+0000","last_peered":"2024-09-10T11:49:51.439047+0000","last_clean":"2024-09-10T11:49:51.439047+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:49:51.439047+0000","last_undegraded":"2024-09-10T11:49:51.439047+0000","last_fullsized":"2024-09-10T11:49:51.439047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431703+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:49:51.431703+0000","last_peered":"2024-09-10T11:49:51.431703+0000","last_clean":"2024-09-10T11:49:51.431703+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:49:51.431703+0000","last_undegraded":"2024-09-10T11:49:51.431703+0000","last_fullsized":"2024-09-10T11:49:51.431703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438202+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:49:46.438202+0000","last_peered":"2024-09-10T11:49:46.438202+0000","last_clean":"2024-09-10T11:49:46.438202+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:49:46.438202+0000","last_undegraded":"2024-09-10T11:49:46.438202+0000","last_fullsized":"2024-09-10T11:49:46.438202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435797+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:49:46.435797+0000","last_peered":"2024-09-10T11:49:46.435797+0000","last_clean":"2024-09-10T11:49:46.435797+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:49:46.435797+0000","last_undegraded":"2024-09-10T11:49:46.435797+0000","last_fullsized":"2024-09-10T11:49:46.435797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436559+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:49:46.436559+0000","last_peered":"2024-09-10T11:49:46.436559+0000","last_clean":"2024-09-10T11:49:46.436559+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:49:46.436559+0000","last_undegraded":"2024-09-10T11:49:46.436559+0000","last_fullsized":"2024-09-10T11:49:46.436559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434727+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:49:46.434727+0000","last_peered":"2024-09-10T11:49:46.434727+0000","last_clean":"2024-09-10T11:49:46.434727+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:49:46.434727+0000","last_undegraded":"2024-09-10T11:49:46.434727+0000","last_fullsized":"2024-09-10T11:49:46.434727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430017+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:49:46.430017+0000","last_peered":"2024-09-10T11:49:46.430017+0000","last_clean":"2024-09-10T11:49:46.430017+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:49:46.430017+0000","last_undegraded":"2024-09-10T11:49:46.430017+0000","last_fullsized":"2024-09-10T11:49:46.430017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437160+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:49:41.437160+0000","last_peered":"2024-09-10T11:49:41.437160+0000","last_clean":"2024-09-10T11:49:41.437160+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:49:41.437160+0000","last_undegraded":"2024-09-10T11:49:41.437160+0000","last_fullsized":"2024-09-10T11:49:41.437160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429267+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:49:41.429267+0000","last_peered":"2024-09-10T11:49:41.429267+0000","last_clean":"2024-09-10T11:49:41.429267+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:49:41.429267+0000","last_undegraded":"2024-09-10T11:49:41.429267+0000","last_fullsized":"2024-09-10T11:49:41.429267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.433795+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:49:41.433795+0000","last_peered":"2024-09-10T11:49:41.433795+0000","last_clean":"2024-09-10T11:49:41.433795+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:49:41.433795+0000","last_undegraded":"2024-09-10T11:49:41.433795+0000","last_fullsized":"2024-09-10T11:49:41.433795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427797+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:49:39.427797+0000","last_peered":"2024-09-10T11:49:39.427797+0000","last_clean":"2024-09-10T11:49:39.427797+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:49:39.427797+0000","last_undegraded":"2024-09-10T11:49:39.427797+0000","last_fullsized":"2024-09-10T11:49:39.427797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427772+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:49:39.427772+0000","last_peered":"2024-09-10T11:49:39.427772+0000","last_clean":"2024-09-10T11:49:39.427772+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:49:39.427772+0000","last_undegraded":"2024-09-10T11:49:39.427772+0000","last_fullsized":"2024-09-10T11:49:39.427772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428301+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:49:36.428301+0000","last_peered":"2024-09-10T11:49:36.428301+0000","last_clean":"2024-09-10T11:49:36.428301+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:49:36.428301+0000","last_undegraded":"2024-09-10T11:49:36.428301+0000","last_fullsized":"2024-09-10T11:49:36.428301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436262+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:49:36.436262+0000","last_peered":"2024-09-10T11:49:36.436262+0000","last_clean":"2024-09-10T11:49:36.436262+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:49:36.436262+0000","last_undegraded":"2024-09-10T11:49:36.436262+0000","last_fullsized":"2024-09-10T11:49:36.436262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.429212+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:49:36.429212+0000","last_peered":"2024-09-10T11:49:36.429212+0000","last_clean":"2024-09-10T11:49:36.429212+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:49:36.429212+0000","last_undegraded":"2024-09-10T11:49:36.429212+0000","last_fullsized":"2024-09-10T11:49:36.429212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432744+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:49:36.432744+0000","last_peered":"2024-09-10T11:49:36.432744+0000","last_clean":"2024-09-10T11:49:36.432744+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:49:36.432744+0000","last_undegraded":"2024-09-10T11:49:36.432744+0000","last_fullsized":"2024-09-10T11:49:36.432744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437881+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:50:01.437881+0000","last_peered":"2024-09-10T11:50:01.437881+0000","last_clean":"2024-09-10T11:50:01.437881+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:50:01.437881+0000","last_undegraded":"2024-09-10T11:50:01.437881+0000","last_fullsized":"2024-09-10T11:50:01.437881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431860+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:49:56.431860+0000","last_peered":"2024-09-10T11:49:56.431860+0000","last_clean":"2024-09-10T11:49:56.431860+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:49:56.431860+0000","last_undegraded":"2024-09-10T11:49:56.431860+0000","last_fullsized":"2024-09-10T11:49:56.431860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438909+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:50:01.438909+0000","last_peered":"2024-09-10T11:50:01.438909+0000","last_clean":"2024-09-10T11:50:01.438909+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:50:01.438909+0000","last_undegraded":"2024-09-10T11:50:01.438909+0000","last_fullsized":"2024-09-10T11:50:01.438909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.439795+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:49:56.439795+0000","last_peered":"2024-09-10T11:49:56.439795+0000","last_clean":"2024-09-10T11:49:56.439795+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:49:56.439795+0000","last_undegraded":"2024-09-10T11:49:56.439795+0000","last_fullsized":"2024-09-10T11:49:56.439795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430158+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:49:54.430158+0000","last_peered":"2024-09-10T11:49:54.430158+0000","last_clean":"2024-09-10T11:49:54.430158+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:49:54.430158+0000","last_undegraded":"2024-09-10T11:49:54.430158+0000","last_fullsized":"2024-09-10T11:49:54.430158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431811+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:49:56.431811+0000","last_peered":"2024-09-10T11:49:56.431811+0000","last_clean":"2024-09-10T11:49:56.431811+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:49:56.431811+0000","last_undegraded":"2024-09-10T11:49:56.431811+0000","last_fullsized":"2024-09-10T11:49:56.431811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438899+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:49:51.438899+0000","last_peered":"2024-09-10T11:49:51.438899+0000","last_clean":"2024-09-10T11:49:51.438899+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:49:51.438899+0000","last_undegraded":"2024-09-10T11:49:51.438899+0000","last_fullsized":"2024-09-10T11:49:51.438899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.438050+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:49:56.438050+0000","last_peered":"2024-09-10T11:49:56.438050+0000","last_clean":"2024-09-10T11:49:56.438050+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:49:56.438050+0000","last_undegraded":"2024-09-10T11:49:56.438050+0000","last_fullsized":"2024-09-10T11:49:56.438050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435922+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:49:51.435922+0000","last_peered":"2024-09-10T11:49:51.435922+0000","last_clean":"2024-09-10T11:49:51.435922+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:49:51.435922+0000","last_undegraded":"2024-09-10T11:49:51.435922+0000","last_fullsized":"2024-09-10T11:49:51.435922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436869+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:49:56.436869+0000","last_peered":"2024-09-10T11:49:56.436869+0000","last_clean":"2024-09-10T11:49:56.436869+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:49:56.436869+0000","last_undegraded":"2024-09-10T11:49:56.436869+0000","last_fullsized":"2024-09-10T11:49:56.436869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.436613+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:49:51.436613+0000","last_peered":"2024-09-10T11:49:51.436613+0000","last_clean":"2024-09-10T11:49:51.436613+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:49:51.436613+0000","last_undegraded":"2024-09-10T11:49:51.436613+0000","last_fullsized":"2024-09-10T11:49:51.436613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431909+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:49:56.431909+0000","last_peered":"2024-09-10T11:49:56.431909+0000","last_clean":"2024-09-10T11:49:56.431909+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:49:56.431909+0000","last_undegraded":"2024-09-10T11:49:56.431909+0000","last_fullsized":"2024-09-10T11:49:56.431909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431666+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:49:51.431666+0000","last_peered":"2024-09-10T11:49:51.431666+0000","last_clean":"2024-09-10T11:49:51.431666+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:49:51.431666+0000","last_undegraded":"2024-09-10T11:49:51.431666+0000","last_fullsized":"2024-09-10T11:49:51.431666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438994+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:49:51.438994+0000","last_peered":"2024-09-10T11:49:51.438994+0000","last_clean":"2024-09-10T11:49:51.438994+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:49:51.438994+0000","last_undegraded":"2024-09-10T11:49:51.438994+0000","last_fullsized":"2024-09-10T11:49:51.438994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434743+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:49:46.434743+0000","last_peered":"2024-09-10T11:49:46.434743+0000","last_clean":"2024-09-10T11:49:46.434743+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:49:46.434743+0000","last_undegraded":"2024-09-10T11:49:46.434743+0000","last_fullsized":"2024-09-10T11:49:46.434743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437662+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:49:56.437662+0000","last_peered":"2024-09-10T11:49:56.437662+0000","last_clean":"2024-09-10T11:49:56.437662+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:49:56.437662+0000","last_undegraded":"2024-09-10T11:49:56.437662+0000","last_fullsized":"2024-09-10T11:49:56.437662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430815+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:49:46.430815+0000","last_peered":"2024-09-10T11:49:46.430815+0000","last_clean":"2024-09-10T11:49:46.430815+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:49:46.430815+0000","last_undegraded":"2024-09-10T11:49:46.430815+0000","last_fullsized":"2024-09-10T11:49:46.430815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429393+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:49:49.429393+0000","last_peered":"2024-09-10T11:49:49.429393+0000","last_clean":"2024-09-10T11:49:49.429393+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:49:49.429393+0000","last_undegraded":"2024-09-10T11:49:49.429393+0000","last_fullsized":"2024-09-10T11:49:49.429393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438128+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:49:46.438128+0000","last_peered":"2024-09-10T11:49:46.438128+0000","last_clean":"2024-09-10T11:49:46.438128+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:49:46.438128+0000","last_undegraded":"2024-09-10T11:49:46.438128+0000","last_fullsized":"2024-09-10T11:49:46.438128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438966+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:49:51.438966+0000","last_peered":"2024-09-10T11:49:51.438966+0000","last_clean":"2024-09-10T11:49:51.438966+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:49:51.438966+0000","last_undegraded":"2024-09-10T11:49:51.438966+0000","last_fullsized":"2024-09-10T11:49:51.438966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435759+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:49:46.435759+0000","last_peered":"2024-09-10T11:49:46.435759+0000","last_clean":"2024-09-10T11:49:46.435759+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:49:46.435759+0000","last_undegraded":"2024-09-10T11:49:46.435759+0000","last_fullsized":"2024-09-10T11:49:46.435759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435809+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:49:51.435809+0000","last_peered":"2024-09-10T11:49:51.435809+0000","last_clean":"2024-09-10T11:49:51.435809+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:49:51.435809+0000","last_undegraded":"2024-09-10T11:49:51.435809+0000","last_fullsized":"2024-09-10T11:49:51.435809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436510+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:49:46.436510+0000","last_peered":"2024-09-10T11:49:46.436510+0000","last_clean":"2024-09-10T11:49:46.436510+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:49:46.436510+0000","last_undegraded":"2024-09-10T11:49:46.436510+0000","last_fullsized":"2024-09-10T11:49:46.436510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438925+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:49:51.438925+0000","last_peered":"2024-09-10T11:49:51.438925+0000","last_clean":"2024-09-10T11:49:51.438925+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:49:51.438925+0000","last_undegraded":"2024-09-10T11:49:51.438925+0000","last_fullsized":"2024-09-10T11:49:51.438925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435056+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:49:41.435056+0000","last_peered":"2024-09-10T11:49:41.435056+0000","last_clean":"2024-09-10T11:49:41.435056+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:49:41.435056+0000","last_undegraded":"2024-09-10T11:49:41.435056+0000","last_fullsized":"2024-09-10T11:49:41.435056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434831+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:49:46.434831+0000","last_peered":"2024-09-10T11:49:46.434831+0000","last_clean":"2024-09-10T11:49:46.434831+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:49:46.434831+0000","last_undegraded":"2024-09-10T11:49:46.434831+0000","last_fullsized":"2024-09-10T11:49:46.434831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435747+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:49:41.435747+0000","last_peered":"2024-09-10T11:49:41.435747+0000","last_clean":"2024-09-10T11:49:41.435747+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:49:41.435747+0000","last_undegraded":"2024-09-10T11:49:41.435747+0000","last_fullsized":"2024-09-10T11:49:41.435747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435859+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:49:46.435859+0000","last_peered":"2024-09-10T11:49:46.435859+0000","last_clean":"2024-09-10T11:49:46.435859+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:49:46.435859+0000","last_undegraded":"2024-09-10T11:49:46.435859+0000","last_fullsized":"2024-09-10T11:49:46.435859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429216+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:49:41.429216+0000","last_peered":"2024-09-10T11:49:41.429216+0000","last_clean":"2024-09-10T11:49:41.429216+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:49:41.429216+0000","last_undegraded":"2024-09-10T11:49:41.429216+0000","last_fullsized":"2024-09-10T11:49:41.429216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435817+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:49:46.435817+0000","last_peered":"2024-09-10T11:49:46.435817+0000","last_clean":"2024-09-10T11:49:46.435817+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:49:46.435817+0000","last_undegraded":"2024-09-10T11:49:46.435817+0000","last_fullsized":"2024-09-10T11:49:46.435817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:44.428573+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:49:44.428573+0000","last_peered":"2024-09-10T11:49:44.428573+0000","last_clean":"2024-09-10T11:49:44.428573+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:49:44.428573+0000","last_undegraded":"2024-09-10T11:49:44.428573+0000","last_fullsized":"2024-09-10T11:49:44.428573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438182+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:49:46.438182+0000","last_peered":"2024-09-10T11:49:46.438182+0000","last_clean":"2024-09-10T11:49:46.438182+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:49:46.438182+0000","last_undegraded":"2024-09-10T11:49:46.438182+0000","last_fullsized":"2024-09-10T11:49:46.438182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:21.429807+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:49:21.429807+0000","last_peered":"2024-09-10T11:49:21.429807+0000","last_clean":"2024-09-10T11:49:21.429807+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:49:21.429807+0000","last_undegraded":"2024-09-10T11:49:21.429807+0000","last_fullsized":"2024-09-10T11:49:21.429807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435419+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:49:31.435419+0000","last_peered":"2024-09-10T11:49:31.435419+0000","last_clean":"2024-09-10T11:49:31.435419+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:49:31.435419+0000","last_undegraded":"2024-09-10T11:49:31.435419+0000","last_fullsized":"2024-09-10T11:49:31.435419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434760+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:49:36.434760+0000","last_peered":"2024-09-10T11:49:36.434760+0000","last_clean":"2024-09-10T11:49:36.434760+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:49:36.434760+0000","last_undegraded":"2024-09-10T11:49:36.434760+0000","last_fullsized":"2024-09-10T11:49:36.434760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.434506+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:49:26.434506+0000","last_peered":"2024-09-10T11:49:26.434506+0000","last_clean":"2024-09-10T11:49:26.434506+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:49:26.434506+0000","last_undegraded":"2024-09-10T11:49:26.434506+0000","last_fullsized":"2024-09-10T11:49:26.434506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426883+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:49:34.426883+0000","last_peered":"2024-09-10T11:49:34.426883+0000","last_clean":"2024-09-10T11:49:34.426883+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:49:34.426883+0000","last_undegraded":"2024-09-10T11:49:34.426883+0000","last_fullsized":"2024-09-10T11:49:34.426883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.428445+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:49:31.428445+0000","last_peered":"2024-09-10T11:49:31.428445+0000","last_clean":"2024-09-10T11:49:31.428445+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:49:31.428445+0000","last_undegraded":"2024-09-10T11:49:31.428445+0000","last_fullsized":"2024-09-10T11:49:31.428445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427438+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:49:31.427438+0000","last_peered":"2024-09-10T11:49:31.427438+0000","last_clean":"2024-09-10T11:49:31.427438+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:49:31.427438+0000","last_undegraded":"2024-09-10T11:49:31.427438+0000","last_fullsized":"2024-09-10T11:49:31.427438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435377+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:49:31.435377+0000","last_peered":"2024-09-10T11:49:31.435377+0000","last_clean":"2024-09-10T11:49:31.435377+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:49:31.435377+0000","last_undegraded":"2024-09-10T11:49:31.435377+0000","last_fullsized":"2024-09-10T11:49:31.435377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434189+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:49:36.434189+0000","last_peered":"2024-09-10T11:49:36.434189+0000","last_clean":"2024-09-10T11:49:36.434189+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:49:36.434189+0000","last_undegraded":"2024-09-10T11:49:36.434189+0000","last_fullsized":"2024-09-10T11:49:36.434189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427490+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:49:31.427490+0000","last_peered":"2024-09-10T11:49:31.427490+0000","last_clean":"2024-09-10T11:49:31.427490+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:49:31.427490+0000","last_undegraded":"2024-09-10T11:49:31.427490+0000","last_fullsized":"2024-09-10T11:49:31.427490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432822+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:49:36.432822+0000","last_peered":"2024-09-10T11:49:36.432822+0000","last_clean":"2024-09-10T11:49:36.432822+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:49:36.432822+0000","last_undegraded":"2024-09-10T11:49:36.432822+0000","last_fullsized":"2024-09-10T11:49:36.432822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435448+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:49:31.435448+0000","last_peered":"2024-09-10T11:49:31.435448+0000","last_clean":"2024-09-10T11:49:31.435448+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:49:31.435448+0000","last_undegraded":"2024-09-10T11:49:31.435448+0000","last_fullsized":"2024-09-10T11:49:31.435448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426945+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:49:34.426945+0000","last_peered":"2024-09-10T11:49:34.426945+0000","last_clean":"2024-09-10T11:49:34.426945+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:49:34.426945+0000","last_undegraded":"2024-09-10T11:49:34.426945+0000","last_fullsized":"2024-09-10T11:49:34.426945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434806+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:49:36.434806+0000","last_peered":"2024-09-10T11:49:36.434806+0000","last_clean":"2024-09-10T11:49:36.434806+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:49:36.434806+0000","last_undegraded":"2024-09-10T11:49:36.434806+0000","last_fullsized":"2024-09-10T11:49:36.434806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435792+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:49:41.435792+0000","last_peered":"2024-09-10T11:49:41.435792+0000","last_clean":"2024-09-10T11:49:41.435792+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:49:41.435792+0000","last_undegraded":"2024-09-10T11:49:41.435792+0000","last_fullsized":"2024-09-10T11:49:41.435792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436374+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:49:36.436374+0000","last_peered":"2024-09-10T11:49:36.436374+0000","last_clean":"2024-09-10T11:49:36.436374+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:49:36.436374+0000","last_undegraded":"2024-09-10T11:49:36.436374+0000","last_fullsized":"2024-09-10T11:49:36.436374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435715+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:49:41.435715+0000","last_peered":"2024-09-10T11:49:41.435715+0000","last_clean":"2024-09-10T11:49:41.435715+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:49:41.435715+0000","last_undegraded":"2024-09-10T11:49:41.435715+0000","last_fullsized":"2024-09-10T11:49:41.435715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434146+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:49:36.434146+0000","last_peered":"2024-09-10T11:49:36.434146+0000","last_clean":"2024-09-10T11:49:36.434146+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:49:36.434146+0000","last_undegraded":"2024-09-10T11:49:36.434146+0000","last_fullsized":"2024-09-10T11:49:36.434146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437230+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:49:41.437230+0000","last_peered":"2024-09-10T11:49:41.437230+0000","last_clean":"2024-09-10T11:49:41.437230+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:49:41.437230+0000","last_undegraded":"2024-09-10T11:49:41.437230+0000","last_fullsized":"2024-09-10T11:49:41.437230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434724+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:49:36.434724+0000","last_peered":"2024-09-10T11:49:36.434724+0000","last_clean":"2024-09-10T11:49:36.434724+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:49:36.434724+0000","last_undegraded":"2024-09-10T11:49:36.434724+0000","last_fullsized":"2024-09-10T11:49:36.434724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435652+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:49:41.435652+0000","last_peered":"2024-09-10T11:49:41.435652+0000","last_clean":"2024-09-10T11:49:41.435652+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:49:41.435652+0000","last_undegraded":"2024-09-10T11:49:41.435652+0000","last_fullsized":"2024-09-10T11:49:41.435652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427732+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:49:39.427732+0000","last_peered":"2024-09-10T11:49:39.427732+0000","last_clean":"2024-09-10T11:49:39.427732+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:49:39.427732+0000","last_undegraded":"2024-09-10T11:49:39.427732+0000","last_fullsized":"2024-09-10T11:49:39.427732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430777+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:49:46.430777+0000","last_peered":"2024-09-10T11:49:46.430777+0000","last_clean":"2024-09-10T11:49:46.430777+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:49:46.430777+0000","last_undegraded":"2024-09-10T11:49:46.430777+0000","last_fullsized":"2024-09-10T11:49:46.430777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437325+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:49:41.437325+0000","last_peered":"2024-09-10T11:49:41.437325+0000","last_clean":"2024-09-10T11:49:41.437325+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:49:41.437325+0000","last_undegraded":"2024-09-10T11:49:41.437325+0000","last_fullsized":"2024-09-10T11:49:41.437325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437268+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:49:41.437268+0000","last_peered":"2024-09-10T11:49:41.437268+0000","last_clean":"2024-09-10T11:49:41.437268+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:49:41.437268+0000","last_undegraded":"2024-09-10T11:49:41.437268+0000","last_fullsized":"2024-09-10T11:49:41.437268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.440585+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:50:01.440585+0000","last_peered":"2024-09-10T11:50:01.440585+0000","last_clean":"2024-09-10T11:50:01.440585+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:50:01.440585+0000","last_undegraded":"2024-09-10T11:50:01.440585+0000","last_fullsized":"2024-09-10T11:50:01.440585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437593+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:49:56.437593+0000","last_peered":"2024-09-10T11:49:56.437593+0000","last_clean":"2024-09-10T11:49:56.437593+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:49:56.437593+0000","last_undegraded":"2024-09-10T11:49:56.437593+0000","last_fullsized":"2024-09-10T11:49:56.437593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437936+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:50:01.437936+0000","last_peered":"2024-09-10T11:50:01.437936+0000","last_clean":"2024-09-10T11:50:01.437936+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:50:01.437936+0000","last_undegraded":"2024-09-10T11:50:01.437936+0000","last_fullsized":"2024-09-10T11:50:01.437936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437692+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:49:56.437692+0000","last_peered":"2024-09-10T11:49:56.437692+0000","last_clean":"2024-09-10T11:49:56.437692+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:49:56.437692+0000","last_undegraded":"2024-09-10T11:49:56.437692+0000","last_fullsized":"2024-09-10T11:49:56.437692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428397+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:49:36.428397+0000","last_peered":"2024-09-10T11:49:36.428397+0000","last_clean":"2024-09-10T11:49:36.428397+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:49:36.428397+0000","last_undegraded":"2024-09-10T11:49:36.428397+0000","last_fullsized":"2024-09-10T11:49:36.428397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.426657+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:49:26.426657+0000","last_peered":"2024-09-10T11:49:26.426657+0000","last_clean":"2024-09-10T11:49:26.426657+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:49:26.426657+0000","last_undegraded":"2024-09-10T11:49:26.426657+0000","last_fullsized":"2024-09-10T11:49:26.426657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427539+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:49:31.427539+0000","last_peered":"2024-09-10T11:49:31.427539+0000","last_clean":"2024-09-10T11:49:31.427539+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:49:31.427539+0000","last_undegraded":"2024-09-10T11:49:31.427539+0000","last_fullsized":"2024-09-10T11:49:31.427539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.433884+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:49:31.433884+0000","last_peered":"2024-09-10T11:49:31.433884+0000","last_clean":"2024-09-10T11:49:31.433884+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:49:31.433884+0000","last_undegraded":"2024-09-10T11:49:31.433884+0000","last_fullsized":"2024-09-10T11:49:31.433884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":93272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":683608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":95432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":94760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":93148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:52:40.380 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T11:52:40.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2539307115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 msgr2=0x7f499006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 --2- 172.21.15.78:0/2539307115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f499006f870 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f499006e460 tx=0x7f498001c830 comp rx=0 tx=0).stop 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2539307115 shutdown_connections 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 --2- 172.21.15.78:0/2539307115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f499006f870 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 --2- 172.21.15.78:0/2539307115 >> v2:172.21.15.112:3300/0 conn(0x7f49901582b0 0x7f49900b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2539307115 >> 172.21.15.78:0/2539307115 conn(0x7f49900cf7c0 msgr2=0x7f49900cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2539307115 shutdown_connections 2024-09-10T11:52:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2539307115 wait complete. 2024-09-10T11:52:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 Processor -- start 2024-09-10T11:52:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- start start 2024-09-10T11:52:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f499006fdb0 0x7f499014b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f49901f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49901582b0 0x7f4990159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4990167790 con 0x7f49900b49e0 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4990167610 con 0x7f49901582b0 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4990167910 con 0x7f499006fdb0 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f49901f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f49901f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37626/0 (socket says 172.21.15.78:37626) 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 -- 172.21.15.78:0/2150304964 learned_addr learned my addr 172.21.15.78:0/2150304964 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 -- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f499006fdb0 msgr2=0x7f499014b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f499006fdb0 0x7f499014b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 -- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49901582b0 msgr2=0x7f4990159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49901582b0 0x7f4990159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 -- 172.21.15.78:0/2150304964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49901f8fa0 con 0x7f49900b49e0 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4994cb5640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f49901f85c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f498001aee0 tx=0x7f49800a66f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49800bc020 con 0x7f49900b49e0 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4980004490 con 0x7f49900b49e0 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980005290 con 0x7f49900b49e0 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49901f9280 con 0x7f49900b49e0 2024-09-10T11:52:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.530+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49901f6610 con 0x7f49900b49e0 2024-09-10T11:52:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.534+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49901f94c0 con 0x7f49900b49e0 2024-09-10T11:52:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.534+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f49800bf070 con 0x7f49900b49e0 2024-09-10T11:52:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.534+0000 7f4985ffb640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f497406f740 0x7f4974071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.534+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4980129b10 con 0x7f49900b49e0 2024-09-10T11:52:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.534+0000 7f49954b6640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f497406f740 0x7f4974071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.534+0000 7f49954b6640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f497406f740 0x7f4974071c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f498c0058d0 tx=0x7f498c005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.538+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f49901f94c0 con 0x7f49900b49e0 2024-09-10T11:52:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.670+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49901f6810 con 0x7f497406f740 2024-09-10T11:52:40.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.678+0000 7f4985ffb640 1 -- 172.21.15.78:0/2150304964 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251814 (secure 0 0 0) 0x7f49901f6810 con 0x7f497406f740 2024-09-10T11:52:40.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:52:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f497406f740 msgr2=0x7f4974071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f497406f740 0x7f4974071c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f498c0058d0 tx=0x7f498c005860 comp rx=0 tx=0).stop 2024-09-10T11:52:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 msgr2=0x7f49901f85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f49901f85c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f498001aee0 tx=0x7f49800a66f0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 shutdown_connections 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49901582b0 0x7f4990159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f497406f740 0x7f4974071c00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49900b49e0 0x7f49901f85c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 --2- 172.21.15.78:0/2150304964 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f499006fdb0 0x7f499014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 >> 172.21.15.78:0/2150304964 conn(0x7f49900cf7c0 msgr2=0x7f499015c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 shutdown_connections 2024-09-10T11:52:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.682+0000 7f499771a640 1 -- 172.21.15.78:0/2150304964 wait complete. 2024-09-10T11:52:40.699 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-10T11:52:39.360189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223640,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751080,"statfs":{"total":773094113280,"available":772865105920,"internally_reserved":0,"allocated":3317760,"data_stored":1930740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005421"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434244+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:49:36.434244+0000","last_peered":"2024-09-10T11:49:36.434244+0000","last_clean":"2024-09-10T11:49:36.434244+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:49:36.434244+0000","last_undegraded":"2024-09-10T11:49:36.434244+0000","last_fullsized":"2024-09-10T11:49:36.434244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428368+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:49:36.428368+0000","last_peered":"2024-09-10T11:49:36.428368+0000","last_clean":"2024-09-10T11:49:36.428368+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:49:36.428368+0000","last_undegraded":"2024-09-10T11:49:36.428368+0000","last_fullsized":"2024-09-10T11:49:36.428368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428343+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:49:36.428343+0000","last_peered":"2024-09-10T11:49:36.428343+0000","last_clean":"2024-09-10T11:49:36.428343+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:49:36.428343+0000","last_undegraded":"2024-09-10T11:49:36.428343+0000","last_fullsized":"2024-09-10T11:49:36.428343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.431756+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:49:31.431756+0000","last_peered":"2024-09-10T11:49:31.431756+0000","last_clean":"2024-09-10T11:49:31.431756+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:49:31.431756+0000","last_undegraded":"2024-09-10T11:49:31.431756+0000","last_fullsized":"2024-09-10T11:49:31.431756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:48:11.416638+0000","last_change":"2024-09-10T11:48:08.362038+0000","last_active":"2024-09-10T11:48:11.416638+0000","last_peered":"2024-09-10T11:48:11.416638+0000","last_clean":"2024-09-10T11:48:11.416638+0000","last_became_active":"2024-09-10T11:48:08.361135+0000","last_became_peered":"2024-09-10T11:48:08.361135+0000","last_unstale":"2024-09-10T11:48:11.416638+0000","last_undegraded":"2024-09-10T11:48:11.416638+0000","last_fullsized":"2024-09-10T11:48:11.416638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:10.036485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437880+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:50:01.437880+0000","last_peered":"2024-09-10T11:50:01.437880+0000","last_clean":"2024-09-10T11:50:01.437880+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:50:01.437880+0000","last_undegraded":"2024-09-10T11:50:01.437880+0000","last_fullsized":"2024-09-10T11:50:01.437880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438586+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:50:01.438586+0000","last_peered":"2024-09-10T11:50:01.438586+0000","last_clean":"2024-09-10T11:50:01.438586+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:50:01.438586+0000","last_undegraded":"2024-09-10T11:50:01.438586+0000","last_fullsized":"2024-09-10T11:50:01.438586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.432667+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:50:01.432667+0000","last_peered":"2024-09-10T11:50:01.432667+0000","last_clean":"2024-09-10T11:50:01.432667+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:50:01.432667+0000","last_undegraded":"2024-09-10T11:50:01.432667+0000","last_fullsized":"2024-09-10T11:50:01.432667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436877+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:49:56.436877+0000","last_peered":"2024-09-10T11:49:56.436877+0000","last_clean":"2024-09-10T11:49:56.436877+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:49:56.436877+0000","last_undegraded":"2024-09-10T11:49:56.436877+0000","last_fullsized":"2024-09-10T11:49:56.436877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437733+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:49:56.437733+0000","last_peered":"2024-09-10T11:49:56.437733+0000","last_clean":"2024-09-10T11:49:56.437733+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:49:56.437733+0000","last_undegraded":"2024-09-10T11:49:56.437733+0000","last_fullsized":"2024-09-10T11:49:56.437733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437633+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:49:56.437633+0000","last_peered":"2024-09-10T11:49:56.437633+0000","last_clean":"2024-09-10T11:49:56.437633+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:49:56.437633+0000","last_undegraded":"2024-09-10T11:49:56.437633+0000","last_fullsized":"2024-09-10T11:49:56.437633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437534+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:49:56.437534+0000","last_peered":"2024-09-10T11:49:56.437534+0000","last_clean":"2024-09-10T11:49:56.437534+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:49:56.437534+0000","last_undegraded":"2024-09-10T11:49:56.437534+0000","last_fullsized":"2024-09-10T11:49:56.437534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430214+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:49:54.430214+0000","last_peered":"2024-09-10T11:49:54.430214+0000","last_clean":"2024-09-10T11:49:54.430214+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:49:54.430214+0000","last_undegraded":"2024-09-10T11:49:54.430214+0000","last_fullsized":"2024-09-10T11:49:54.430214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429349+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:49:49.429349+0000","last_peered":"2024-09-10T11:49:49.429349+0000","last_clean":"2024-09-10T11:49:49.429349+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:49:49.429349+0000","last_undegraded":"2024-09-10T11:49:49.429349+0000","last_fullsized":"2024-09-10T11:49:49.429349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.430994+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:49:51.430994+0000","last_peered":"2024-09-10T11:49:51.430994+0000","last_clean":"2024-09-10T11:49:51.430994+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:49:51.430994+0000","last_undegraded":"2024-09-10T11:49:51.430994+0000","last_fullsized":"2024-09-10T11:49:51.430994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438862+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:49:51.438862+0000","last_peered":"2024-09-10T11:49:51.438862+0000","last_clean":"2024-09-10T11:49:51.438862+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:49:51.438862+0000","last_undegraded":"2024-09-10T11:49:51.438862+0000","last_fullsized":"2024-09-10T11:49:51.438862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.439047+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:49:51.439047+0000","last_peered":"2024-09-10T11:49:51.439047+0000","last_clean":"2024-09-10T11:49:51.439047+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:49:51.439047+0000","last_undegraded":"2024-09-10T11:49:51.439047+0000","last_fullsized":"2024-09-10T11:49:51.439047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431703+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:49:51.431703+0000","last_peered":"2024-09-10T11:49:51.431703+0000","last_clean":"2024-09-10T11:49:51.431703+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:49:51.431703+0000","last_undegraded":"2024-09-10T11:49:51.431703+0000","last_fullsized":"2024-09-10T11:49:51.431703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438202+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:49:46.438202+0000","last_peered":"2024-09-10T11:49:46.438202+0000","last_clean":"2024-09-10T11:49:46.438202+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:49:46.438202+0000","last_undegraded":"2024-09-10T11:49:46.438202+0000","last_fullsized":"2024-09-10T11:49:46.438202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435797+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:49:46.435797+0000","last_peered":"2024-09-10T11:49:46.435797+0000","last_clean":"2024-09-10T11:49:46.435797+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:49:46.435797+0000","last_undegraded":"2024-09-10T11:49:46.435797+0000","last_fullsized":"2024-09-10T11:49:46.435797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436559+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:49:46.436559+0000","last_peered":"2024-09-10T11:49:46.436559+0000","last_clean":"2024-09-10T11:49:46.436559+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:49:46.436559+0000","last_undegraded":"2024-09-10T11:49:46.436559+0000","last_fullsized":"2024-09-10T11:49:46.436559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434727+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:49:46.434727+0000","last_peered":"2024-09-10T11:49:46.434727+0000","last_clean":"2024-09-10T11:49:46.434727+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:49:46.434727+0000","last_undegraded":"2024-09-10T11:49:46.434727+0000","last_fullsized":"2024-09-10T11:49:46.434727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430017+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:49:46.430017+0000","last_peered":"2024-09-10T11:49:46.430017+0000","last_clean":"2024-09-10T11:49:46.430017+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:49:46.430017+0000","last_undegraded":"2024-09-10T11:49:46.430017+0000","last_fullsized":"2024-09-10T11:49:46.430017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437160+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:49:41.437160+0000","last_peered":"2024-09-10T11:49:41.437160+0000","last_clean":"2024-09-10T11:49:41.437160+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:49:41.437160+0000","last_undegraded":"2024-09-10T11:49:41.437160+0000","last_fullsized":"2024-09-10T11:49:41.437160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429267+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:49:41.429267+0000","last_peered":"2024-09-10T11:49:41.429267+0000","last_clean":"2024-09-10T11:49:41.429267+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:49:41.429267+0000","last_undegraded":"2024-09-10T11:49:41.429267+0000","last_fullsized":"2024-09-10T11:49:41.429267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.433795+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:49:41.433795+0000","last_peered":"2024-09-10T11:49:41.433795+0000","last_clean":"2024-09-10T11:49:41.433795+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:49:41.433795+0000","last_undegraded":"2024-09-10T11:49:41.433795+0000","last_fullsized":"2024-09-10T11:49:41.433795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427797+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:49:39.427797+0000","last_peered":"2024-09-10T11:49:39.427797+0000","last_clean":"2024-09-10T11:49:39.427797+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:49:39.427797+0000","last_undegraded":"2024-09-10T11:49:39.427797+0000","last_fullsized":"2024-09-10T11:49:39.427797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427772+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:49:39.427772+0000","last_peered":"2024-09-10T11:49:39.427772+0000","last_clean":"2024-09-10T11:49:39.427772+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:49:39.427772+0000","last_undegraded":"2024-09-10T11:49:39.427772+0000","last_fullsized":"2024-09-10T11:49:39.427772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428301+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:49:36.428301+0000","last_peered":"2024-09-10T11:49:36.428301+0000","last_clean":"2024-09-10T11:49:36.428301+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:49:36.428301+0000","last_undegraded":"2024-09-10T11:49:36.428301+0000","last_fullsized":"2024-09-10T11:49:36.428301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436262+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:49:36.436262+0000","last_peered":"2024-09-10T11:49:36.436262+0000","last_clean":"2024-09-10T11:49:36.436262+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:49:36.436262+0000","last_undegraded":"2024-09-10T11:49:36.436262+0000","last_fullsized":"2024-09-10T11:49:36.436262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.429212+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:49:36.429212+0000","last_peered":"2024-09-10T11:49:36.429212+0000","last_clean":"2024-09-10T11:49:36.429212+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:49:36.429212+0000","last_undegraded":"2024-09-10T11:49:36.429212+0000","last_fullsized":"2024-09-10T11:49:36.429212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432744+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:49:36.432744+0000","last_peered":"2024-09-10T11:49:36.432744+0000","last_clean":"2024-09-10T11:49:36.432744+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:49:36.432744+0000","last_undegraded":"2024-09-10T11:49:36.432744+0000","last_fullsized":"2024-09-10T11:49:36.432744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437881+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:50:01.437881+0000","last_peered":"2024-09-10T11:50:01.437881+0000","last_clean":"2024-09-10T11:50:01.437881+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:50:01.437881+0000","last_undegraded":"2024-09-10T11:50:01.437881+0000","last_fullsized":"2024-09-10T11:50:01.437881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431860+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:49:56.431860+0000","last_peered":"2024-09-10T11:49:56.431860+0000","last_clean":"2024-09-10T11:49:56.431860+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:49:56.431860+0000","last_undegraded":"2024-09-10T11:49:56.431860+0000","last_fullsized":"2024-09-10T11:49:56.431860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438909+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:50:01.438909+0000","last_peered":"2024-09-10T11:50:01.438909+0000","last_clean":"2024-09-10T11:50:01.438909+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:50:01.438909+0000","last_undegraded":"2024-09-10T11:50:01.438909+0000","last_fullsized":"2024-09-10T11:50:01.438909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.439795+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:49:56.439795+0000","last_peered":"2024-09-10T11:49:56.439795+0000","last_clean":"2024-09-10T11:49:56.439795+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:49:56.439795+0000","last_undegraded":"2024-09-10T11:49:56.439795+0000","last_fullsized":"2024-09-10T11:49:56.439795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430158+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:49:54.430158+0000","last_peered":"2024-09-10T11:49:54.430158+0000","last_clean":"2024-09-10T11:49:54.430158+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:49:54.430158+0000","last_undegraded":"2024-09-10T11:49:54.430158+0000","last_fullsized":"2024-09-10T11:49:54.430158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431811+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:49:56.431811+0000","last_peered":"2024-09-10T11:49:56.431811+0000","last_clean":"2024-09-10T11:49:56.431811+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:49:56.431811+0000","last_undegraded":"2024-09-10T11:49:56.431811+0000","last_fullsized":"2024-09-10T11:49:56.431811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438899+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:49:51.438899+0000","last_peered":"2024-09-10T11:49:51.438899+0000","last_clean":"2024-09-10T11:49:51.438899+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:49:51.438899+0000","last_undegraded":"2024-09-10T11:49:51.438899+0000","last_fullsized":"2024-09-10T11:49:51.438899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.438050+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:49:56.438050+0000","last_peered":"2024-09-10T11:49:56.438050+0000","last_clean":"2024-09-10T11:49:56.438050+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:49:56.438050+0000","last_undegraded":"2024-09-10T11:49:56.438050+0000","last_fullsized":"2024-09-10T11:49:56.438050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435922+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:49:51.435922+0000","last_peered":"2024-09-10T11:49:51.435922+0000","last_clean":"2024-09-10T11:49:51.435922+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:49:51.435922+0000","last_undegraded":"2024-09-10T11:49:51.435922+0000","last_fullsized":"2024-09-10T11:49:51.435922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436869+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:49:56.436869+0000","last_peered":"2024-09-10T11:49:56.436869+0000","last_clean":"2024-09-10T11:49:56.436869+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:49:56.436869+0000","last_undegraded":"2024-09-10T11:49:56.436869+0000","last_fullsized":"2024-09-10T11:49:56.436869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.436613+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:49:51.436613+0000","last_peered":"2024-09-10T11:49:51.436613+0000","last_clean":"2024-09-10T11:49:51.436613+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:49:51.436613+0000","last_undegraded":"2024-09-10T11:49:51.436613+0000","last_fullsized":"2024-09-10T11:49:51.436613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431909+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:49:56.431909+0000","last_peered":"2024-09-10T11:49:56.431909+0000","last_clean":"2024-09-10T11:49:56.431909+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:49:56.431909+0000","last_undegraded":"2024-09-10T11:49:56.431909+0000","last_fullsized":"2024-09-10T11:49:56.431909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431666+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:49:51.431666+0000","last_peered":"2024-09-10T11:49:51.431666+0000","last_clean":"2024-09-10T11:49:51.431666+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:49:51.431666+0000","last_undegraded":"2024-09-10T11:49:51.431666+0000","last_fullsized":"2024-09-10T11:49:51.431666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438994+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:49:51.438994+0000","last_peered":"2024-09-10T11:49:51.438994+0000","last_clean":"2024-09-10T11:49:51.438994+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:49:51.438994+0000","last_undegraded":"2024-09-10T11:49:51.438994+0000","last_fullsized":"2024-09-10T11:49:51.438994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434743+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:49:46.434743+0000","last_peered":"2024-09-10T11:49:46.434743+0000","last_clean":"2024-09-10T11:49:46.434743+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:49:46.434743+0000","last_undegraded":"2024-09-10T11:49:46.434743+0000","last_fullsized":"2024-09-10T11:49:46.434743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437662+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:49:56.437662+0000","last_peered":"2024-09-10T11:49:56.437662+0000","last_clean":"2024-09-10T11:49:56.437662+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:49:56.437662+0000","last_undegraded":"2024-09-10T11:49:56.437662+0000","last_fullsized":"2024-09-10T11:49:56.437662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430815+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:49:46.430815+0000","last_peered":"2024-09-10T11:49:46.430815+0000","last_clean":"2024-09-10T11:49:46.430815+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:49:46.430815+0000","last_undegraded":"2024-09-10T11:49:46.430815+0000","last_fullsized":"2024-09-10T11:49:46.430815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429393+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:49:49.429393+0000","last_peered":"2024-09-10T11:49:49.429393+0000","last_clean":"2024-09-10T11:49:49.429393+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:49:49.429393+0000","last_undegraded":"2024-09-10T11:49:49.429393+0000","last_fullsized":"2024-09-10T11:49:49.429393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438128+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:49:46.438128+0000","last_peered":"2024-09-10T11:49:46.438128+0000","last_clean":"2024-09-10T11:49:46.438128+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:49:46.438128+0000","last_undegraded":"2024-09-10T11:49:46.438128+0000","last_fullsized":"2024-09-10T11:49:46.438128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438966+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:49:51.438966+0000","last_peered":"2024-09-10T11:49:51.438966+0000","last_clean":"2024-09-10T11:49:51.438966+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:49:51.438966+0000","last_undegraded":"2024-09-10T11:49:51.438966+0000","last_fullsized":"2024-09-10T11:49:51.438966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435759+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:49:46.435759+0000","last_peered":"2024-09-10T11:49:46.435759+0000","last_clean":"2024-09-10T11:49:46.435759+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:49:46.435759+0000","last_undegraded":"2024-09-10T11:49:46.435759+0000","last_fullsized":"2024-09-10T11:49:46.435759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435809+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:49:51.435809+0000","last_peered":"2024-09-10T11:49:51.435809+0000","last_clean":"2024-09-10T11:49:51.435809+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:49:51.435809+0000","last_undegraded":"2024-09-10T11:49:51.435809+0000","last_fullsized":"2024-09-10T11:49:51.435809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436510+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:49:46.436510+0000","last_peered":"2024-09-10T11:49:46.436510+0000","last_clean":"2024-09-10T11:49:46.436510+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:49:46.436510+0000","last_undegraded":"2024-09-10T11:49:46.436510+0000","last_fullsized":"2024-09-10T11:49:46.436510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438925+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:49:51.438925+0000","last_peered":"2024-09-10T11:49:51.438925+0000","last_clean":"2024-09-10T11:49:51.438925+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:49:51.438925+0000","last_undegraded":"2024-09-10T11:49:51.438925+0000","last_fullsized":"2024-09-10T11:49:51.438925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435056+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:49:41.435056+0000","last_peered":"2024-09-10T11:49:41.435056+0000","last_clean":"2024-09-10T11:49:41.435056+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:49:41.435056+0000","last_undegraded":"2024-09-10T11:49:41.435056+0000","last_fullsized":"2024-09-10T11:49:41.435056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434831+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:49:46.434831+0000","last_peered":"2024-09-10T11:49:46.434831+0000","last_clean":"2024-09-10T11:49:46.434831+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:49:46.434831+0000","last_undegraded":"2024-09-10T11:49:46.434831+0000","last_fullsized":"2024-09-10T11:49:46.434831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435747+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:49:41.435747+0000","last_peered":"2024-09-10T11:49:41.435747+0000","last_clean":"2024-09-10T11:49:41.435747+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:49:41.435747+0000","last_undegraded":"2024-09-10T11:49:41.435747+0000","last_fullsized":"2024-09-10T11:49:41.435747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435859+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:49:46.435859+0000","last_peered":"2024-09-10T11:49:46.435859+0000","last_clean":"2024-09-10T11:49:46.435859+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:49:46.435859+0000","last_undegraded":"2024-09-10T11:49:46.435859+0000","last_fullsized":"2024-09-10T11:49:46.435859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429216+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:49:41.429216+0000","last_peered":"2024-09-10T11:49:41.429216+0000","last_clean":"2024-09-10T11:49:41.429216+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:49:41.429216+0000","last_undegraded":"2024-09-10T11:49:41.429216+0000","last_fullsized":"2024-09-10T11:49:41.429216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435817+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:49:46.435817+0000","last_peered":"2024-09-10T11:49:46.435817+0000","last_clean":"2024-09-10T11:49:46.435817+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:49:46.435817+0000","last_undegraded":"2024-09-10T11:49:46.435817+0000","last_fullsized":"2024-09-10T11:49:46.435817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:44.428573+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:49:44.428573+0000","last_peered":"2024-09-10T11:49:44.428573+0000","last_clean":"2024-09-10T11:49:44.428573+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:49:44.428573+0000","last_undegraded":"2024-09-10T11:49:44.428573+0000","last_fullsized":"2024-09-10T11:49:44.428573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438182+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:49:46.438182+0000","last_peered":"2024-09-10T11:49:46.438182+0000","last_clean":"2024-09-10T11:49:46.438182+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:49:46.438182+0000","last_undegraded":"2024-09-10T11:49:46.438182+0000","last_fullsized":"2024-09-10T11:49:46.438182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:21.429807+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:49:21.429807+0000","last_peered":"2024-09-10T11:49:21.429807+0000","last_clean":"2024-09-10T11:49:21.429807+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:49:21.429807+0000","last_undegraded":"2024-09-10T11:49:21.429807+0000","last_fullsized":"2024-09-10T11:49:21.429807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435419+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:49:31.435419+0000","last_peered":"2024-09-10T11:49:31.435419+0000","last_clean":"2024-09-10T11:49:31.435419+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:49:31.435419+0000","last_undegraded":"2024-09-10T11:49:31.435419+0000","last_fullsized":"2024-09-10T11:49:31.435419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434760+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:49:36.434760+0000","last_peered":"2024-09-10T11:49:36.434760+0000","last_clean":"2024-09-10T11:49:36.434760+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:49:36.434760+0000","last_undegraded":"2024-09-10T11:49:36.434760+0000","last_fullsized":"2024-09-10T11:49:36.434760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.434506+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:49:26.434506+0000","last_peered":"2024-09-10T11:49:26.434506+0000","last_clean":"2024-09-10T11:49:26.434506+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:49:26.434506+0000","last_undegraded":"2024-09-10T11:49:26.434506+0000","last_fullsized":"2024-09-10T11:49:26.434506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426883+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:49:34.426883+0000","last_peered":"2024-09-10T11:49:34.426883+0000","last_clean":"2024-09-10T11:49:34.426883+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:49:34.426883+0000","last_undegraded":"2024-09-10T11:49:34.426883+0000","last_fullsized":"2024-09-10T11:49:34.426883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.428445+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:49:31.428445+0000","last_peered":"2024-09-10T11:49:31.428445+0000","last_clean":"2024-09-10T11:49:31.428445+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:49:31.428445+0000","last_undegraded":"2024-09-10T11:49:31.428445+0000","last_fullsized":"2024-09-10T11:49:31.428445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427438+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:49:31.427438+0000","last_peered":"2024-09-10T11:49:31.427438+0000","last_clean":"2024-09-10T11:49:31.427438+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:49:31.427438+0000","last_undegraded":"2024-09-10T11:49:31.427438+0000","last_fullsized":"2024-09-10T11:49:31.427438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435377+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:49:31.435377+0000","last_peered":"2024-09-10T11:49:31.435377+0000","last_clean":"2024-09-10T11:49:31.435377+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:49:31.435377+0000","last_undegraded":"2024-09-10T11:49:31.435377+0000","last_fullsized":"2024-09-10T11:49:31.435377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434189+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:49:36.434189+0000","last_peered":"2024-09-10T11:49:36.434189+0000","last_clean":"2024-09-10T11:49:36.434189+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:49:36.434189+0000","last_undegraded":"2024-09-10T11:49:36.434189+0000","last_fullsized":"2024-09-10T11:49:36.434189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427490+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:49:31.427490+0000","last_peered":"2024-09-10T11:49:31.427490+0000","last_clean":"2024-09-10T11:49:31.427490+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:49:31.427490+0000","last_undegraded":"2024-09-10T11:49:31.427490+0000","last_fullsized":"2024-09-10T11:49:31.427490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432822+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:49:36.432822+0000","last_peered":"2024-09-10T11:49:36.432822+0000","last_clean":"2024-09-10T11:49:36.432822+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:49:36.432822+0000","last_undegraded":"2024-09-10T11:49:36.432822+0000","last_fullsized":"2024-09-10T11:49:36.432822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435448+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:49:31.435448+0000","last_peered":"2024-09-10T11:49:31.435448+0000","last_clean":"2024-09-10T11:49:31.435448+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:49:31.435448+0000","last_undegraded":"2024-09-10T11:49:31.435448+0000","last_fullsized":"2024-09-10T11:49:31.435448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426945+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:49:34.426945+0000","last_peered":"2024-09-10T11:49:34.426945+0000","last_clean":"2024-09-10T11:49:34.426945+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:49:34.426945+0000","last_undegraded":"2024-09-10T11:49:34.426945+0000","last_fullsized":"2024-09-10T11:49:34.426945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434806+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:49:36.434806+0000","last_peered":"2024-09-10T11:49:36.434806+0000","last_clean":"2024-09-10T11:49:36.434806+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:49:36.434806+0000","last_undegraded":"2024-09-10T11:49:36.434806+0000","last_fullsized":"2024-09-10T11:49:36.434806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435792+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:49:41.435792+0000","last_peered":"2024-09-10T11:49:41.435792+0000","last_clean":"2024-09-10T11:49:41.435792+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:49:41.435792+0000","last_undegraded":"2024-09-10T11:49:41.435792+0000","last_fullsized":"2024-09-10T11:49:41.435792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436374+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:49:36.436374+0000","last_peered":"2024-09-10T11:49:36.436374+0000","last_clean":"2024-09-10T11:49:36.436374+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:49:36.436374+0000","last_undegraded":"2024-09-10T11:49:36.436374+0000","last_fullsized":"2024-09-10T11:49:36.436374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435715+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:49:41.435715+0000","last_peered":"2024-09-10T11:49:41.435715+0000","last_clean":"2024-09-10T11:49:41.435715+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:49:41.435715+0000","last_undegraded":"2024-09-10T11:49:41.435715+0000","last_fullsized":"2024-09-10T11:49:41.435715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434146+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:49:36.434146+0000","last_peered":"2024-09-10T11:49:36.434146+0000","last_clean":"2024-09-10T11:49:36.434146+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:49:36.434146+0000","last_undegraded":"2024-09-10T11:49:36.434146+0000","last_fullsized":"2024-09-10T11:49:36.434146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437230+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:49:41.437230+0000","last_peered":"2024-09-10T11:49:41.437230+0000","last_clean":"2024-09-10T11:49:41.437230+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:49:41.437230+0000","last_undegraded":"2024-09-10T11:49:41.437230+0000","last_fullsized":"2024-09-10T11:49:41.437230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434724+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:49:36.434724+0000","last_peered":"2024-09-10T11:49:36.434724+0000","last_clean":"2024-09-10T11:49:36.434724+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:49:36.434724+0000","last_undegraded":"2024-09-10T11:49:36.434724+0000","last_fullsized":"2024-09-10T11:49:36.434724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435652+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:49:41.435652+0000","last_peered":"2024-09-10T11:49:41.435652+0000","last_clean":"2024-09-10T11:49:41.435652+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:49:41.435652+0000","last_undegraded":"2024-09-10T11:49:41.435652+0000","last_fullsized":"2024-09-10T11:49:41.435652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427732+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:49:39.427732+0000","last_peered":"2024-09-10T11:49:39.427732+0000","last_clean":"2024-09-10T11:49:39.427732+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:49:39.427732+0000","last_undegraded":"2024-09-10T11:49:39.427732+0000","last_fullsized":"2024-09-10T11:49:39.427732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430777+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:49:46.430777+0000","last_peered":"2024-09-10T11:49:46.430777+0000","last_clean":"2024-09-10T11:49:46.430777+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:49:46.430777+0000","last_undegraded":"2024-09-10T11:49:46.430777+0000","last_fullsized":"2024-09-10T11:49:46.430777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437325+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:49:41.437325+0000","last_peered":"2024-09-10T11:49:41.437325+0000","last_clean":"2024-09-10T11:49:41.437325+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:49:41.437325+0000","last_undegraded":"2024-09-10T11:49:41.437325+0000","last_fullsized":"2024-09-10T11:49:41.437325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437268+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:49:41.437268+0000","last_peered":"2024-09-10T11:49:41.437268+0000","last_clean":"2024-09-10T11:49:41.437268+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:49:41.437268+0000","last_undegraded":"2024-09-10T11:49:41.437268+0000","last_fullsized":"2024-09-10T11:49:41.437268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.440585+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:50:01.440585+0000","last_peered":"2024-09-10T11:50:01.440585+0000","last_clean":"2024-09-10T11:50:01.440585+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:50:01.440585+0000","last_undegraded":"2024-09-10T11:50:01.440585+0000","last_fullsized":"2024-09-10T11:50:01.440585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437593+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:49:56.437593+0000","last_peered":"2024-09-10T11:49:56.437593+0000","last_clean":"2024-09-10T11:49:56.437593+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:49:56.437593+0000","last_undegraded":"2024-09-10T11:49:56.437593+0000","last_fullsized":"2024-09-10T11:49:56.437593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437936+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:50:01.437936+0000","last_peered":"2024-09-10T11:50:01.437936+0000","last_clean":"2024-09-10T11:50:01.437936+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:50:01.437936+0000","last_undegraded":"2024-09-10T11:50:01.437936+0000","last_fullsized":"2024-09-10T11:50:01.437936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437692+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:49:56.437692+0000","last_peered":"2024-09-10T11:49:56.437692+0000","last_clean":"2024-09-10T11:49:56.437692+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:49:56.437692+0000","last_undegraded":"2024-09-10T11:49:56.437692+0000","last_fullsized":"2024-09-10T11:49:56.437692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428397+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:49:36.428397+0000","last_peered":"2024-09-10T11:49:36.428397+0000","last_clean":"2024-09-10T11:49:36.428397+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:49:36.428397+0000","last_undegraded":"2024-09-10T11:49:36.428397+0000","last_fullsized":"2024-09-10T11:49:36.428397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.426657+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:49:26.426657+0000","last_peered":"2024-09-10T11:49:26.426657+0000","last_clean":"2024-09-10T11:49:26.426657+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:49:26.426657+0000","last_undegraded":"2024-09-10T11:49:26.426657+0000","last_fullsized":"2024-09-10T11:49:26.426657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427539+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:49:31.427539+0000","last_peered":"2024-09-10T11:49:31.427539+0000","last_clean":"2024-09-10T11:49:31.427539+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:49:31.427539+0000","last_undegraded":"2024-09-10T11:49:31.427539+0000","last_fullsized":"2024-09-10T11:49:31.427539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.433884+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:49:31.433884+0000","last_peered":"2024-09-10T11:49:31.433884+0000","last_clean":"2024-09-10T11:49:31.433884+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:49:31.433884+0000","last_undegraded":"2024-09-10T11:49:31.433884+0000","last_fullsized":"2024-09-10T11:49:31.433884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":93272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":683608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":95432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":94760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":93148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:52:40.703 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:52:40.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1813988920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161630 msgr2=0x7f6a340d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1813988920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161630 0x7f6a340d0540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009900 tx=0x7f6a2401c8b0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1813988920 shutdown_connections 2024-09-10T11:52:40.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1813988920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161630 0x7f6a340d0540 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1813988920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a34161250 0x7f6a340d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1813988920 >> 172.21.15.78:0/1813988920 conn(0x7f6a340d3c80 msgr2=0x7f6a340d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:40.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1813988920 shutdown_connections 2024-09-10T11:52:40.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1813988920 wait complete. 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 Processor -- start 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- start start 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a340b4a10 0x7f6a340c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 0x7f6a34150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a34161630 0x7f6a340b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3416b140 con 0x7f6a34161250 2024-09-10T11:52:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3416afc0 con 0x7f6a340b4a10 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a3be1e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3416b2c0 con 0x7f6a34161630 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 0x7f6a34150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 0x7f6a34150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37642/0 (socket says 172.21.15.78:37642) 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 -- 172.21.15.78:0/1667190016 learned_addr learned my addr 172.21.15.78:0/1667190016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a39bba640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a340b4a10 0x7f6a340c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 -- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a34161630 msgr2=0x7f6a340b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a34161630 0x7f6a340b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 -- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a340b4a10 msgr2=0x7f6a340c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a340b4a10 0x7f6a340c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 -- 172.21.15.78:0/1667190016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a341518d0 con 0x7f6a34161250 2024-09-10T11:52:40.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.862+0000 7f6a393b9640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 0x7f6a34150fd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009850 tx=0x7f6a24005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:40.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a240bc070 con 0x7f6a34161250 2024-09-10T11:52:40.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a24005310 con 0x7f6a34161250 2024-09-10T11:52:40.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a34151bb0 con 0x7f6a34161250 2024-09-10T11:52:40.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a240b2040 con 0x7f6a34161250 2024-09-10T11:52:40.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a340cc200 con 0x7f6a34161250 2024-09-10T11:52:40.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a340d4770 con 0x7f6a34161250 2024-09-10T11:52:40.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f6a240046d0 con 0x7f6a34161250 2024-09-10T11:52:40.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a2a7fc640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6a1806f710 0x7f6a18071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:40.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6a24129da0 con 0x7f6a34161250 2024-09-10T11:52:40.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a39bba640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6a1806f710 0x7f6a18071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:40.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.866+0000 7f6a39bba640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6a1806f710 0x7f6a18071bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a300058d0 tx=0x7f6a30005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:40.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:40.870+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f6a240164d0 con 0x7f6a34161250 2024-09-10T11:52:41.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.002+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a34151f40 con 0x7f6a34161250 2024-09-10T11:52:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a2a7fc640 1 -- 172.21.15.78:0/1667190016 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16706 (secure 0 0 0) 0x7f6a240ff070 con 0x7f6a34161250 2024-09-10T11:52:41.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:41.008 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"785b090d-5d49-42c2-82da-a514da1d8c8c","created":"2024-09-10T11:47:02.308322+0000","modified":"2024-09-10T11:48:08.338199+0000","last_up_change":"2024-09-10T11:47:16.174333+0000","last_in_change":"2024-09-10T11:47:06.038566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:47:17.283715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:47:24.833218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:47:26.032089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be7965a-1b2b-4583-9122-8b52e911393e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6825","nonce":1912853801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6827","nonce":1912853801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6831","nonce":1912853801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1912853801},{"type":"v1","addr":"172.21.15.78:6829","nonce":1912853801}]},"public_addr":"172.21.15.78:6825/1912853801","cluster_addr":"172.21.15.78:6827/1912853801","heartbeat_back_addr":"172.21.15.78:6831/1912853801","heartbeat_front_addr":"172.21.15.78:6829/1912853801","state":["exists","up"]},{"osd":1,"uuid":"3ec6f299-f672-495a-98a9-a6ac33a08989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6801","nonce":672081061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6803","nonce":672081061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6807","nonce":672081061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":672081061},{"type":"v1","addr":"172.21.15.78:6805","nonce":672081061}]},"public_addr":"172.21.15.78:6801/672081061","cluster_addr":"172.21.15.78:6803/672081061","heartbeat_back_addr":"172.21.15.78:6807/672081061","heartbeat_front_addr":"172.21.15.78:6805/672081061","state":["exists","up"]},{"osd":2,"uuid":"62160ac2-9b11-4b6f-a0b9-5b6543c24522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6817","nonce":3600861345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6819","nonce":3600861345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6823","nonce":3600861345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3600861345},{"type":"v1","addr":"172.21.15.78:6821","nonce":3600861345}]},"public_addr":"172.21.15.78:6817/3600861345","cluster_addr":"172.21.15.78:6819/3600861345","heartbeat_back_addr":"172.21.15.78:6823/3600861345","heartbeat_front_addr":"172.21.15.78:6821/3600861345","state":["exists","up"]},{"osd":3,"uuid":"052b01fd-4b1c-44da-a1e1-ebd67f9a8e41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6809","nonce":1722253124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6811","nonce":1722253124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6815","nonce":1722253124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1722253124},{"type":"v1","addr":"172.21.15.78:6813","nonce":1722253124}]},"public_addr":"172.21.15.78:6809/1722253124","cluster_addr":"172.21.15.78:6811/1722253124","heartbeat_back_addr":"172.21.15.78:6815/1722253124","heartbeat_front_addr":"172.21.15.78:6813/1722253124","state":["exists","up"]},{"osd":4,"uuid":"e8246bdc-d4a1-4679-9723-19881cd49d45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6827","nonce":1513593239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6829","nonce":1513593239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6833","nonce":1513593239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":1513593239},{"type":"v1","addr":"172.21.15.112:6831","nonce":1513593239}]},"public_addr":"172.21.15.112:6827/1513593239","cluster_addr":"172.21.15.112:6829/1513593239","heartbeat_back_addr":"172.21.15.112:6833/1513593239","heartbeat_front_addr":"172.21.15.112:6831/1513593239","state":["exists","up"]},{"osd":5,"uuid":"bf28b344-3556-4cac-b45b-78a56c1f6a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6819","nonce":749221931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6821","nonce":749221931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6825","nonce":749221931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":749221931},{"type":"v1","addr":"172.21.15.112:6823","nonce":749221931}]},"public_addr":"172.21.15.112:6819/749221931","cluster_addr":"172.21.15.112:6821/749221931","heartbeat_back_addr":"172.21.15.112:6825/749221931","heartbeat_front_addr":"172.21.15.112:6823/749221931","state":["exists","up"]},{"osd":6,"uuid":"a62440b3-86a4-4dba-986f-dfcbd1cf5571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6803","nonce":2669198428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6805","nonce":2669198428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6809","nonce":2669198428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2669198428},{"type":"v1","addr":"172.21.15.112:6807","nonce":2669198428}]},"public_addr":"172.21.15.112:6803/2669198428","cluster_addr":"172.21.15.112:6805/2669198428","heartbeat_back_addr":"172.21.15.112:6809/2669198428","heartbeat_front_addr":"172.21.15.112:6807/2669198428","state":["exists","up"]},{"osd":7,"uuid":"4af06387-5a4e-49ac-8e62-c912908852f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6811","nonce":485234655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6813","nonce":485234655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6817","nonce":485234655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":485234655},{"type":"v1","addr":"172.21.15.112:6815","nonce":485234655}]},"public_addr":"172.21.15.112:6811/485234655","cluster_addr":"172.21.15.112:6813/485234655","heartbeat_back_addr":"172.21.15.112:6817/485234655","heartbeat_front_addr":"172.21.15.112:6815/485234655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.346952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.439394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.828392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.891635+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.715880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:13.072747+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.179446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:47:12.420776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6a1806f710 msgr2=0x7f6a18071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6a1806f710 0x7f6a18071bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a300058d0 tx=0x7f6a30005860 comp rx=0 tx=0).stop 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 msgr2=0x7f6a34150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 0x7f6a34150fd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009850 tx=0x7f6a24005e00 comp rx=0 tx=0).stop 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 shutdown_connections 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f6a1806f710 0x7f6a18071bd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a34161630 0x7f6a340b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a34161250 0x7f6a34150fd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 --2- 172.21.15.78:0/1667190016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a340b4a10 0x7f6a340c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 >> 172.21.15.78:0/1667190016 conn(0x7f6a340d3c80 msgr2=0x7f6a340b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:41.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 shutdown_connections 2024-09-10T11:52:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:41.006+0000 7f6a3be1e640 1 -- 172.21.15.78:0/1667190016 wait complete. 2024-09-10T11:52:42.027 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T11:52:42.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:42.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 -- 172.21.15.78:0/44001181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98157cd0 msgr2=0x7f5a9815dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/44001181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98157cd0 0x7f5a9815dd40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5a980cf610 tx=0x7f5a9001c800 comp rx=0 tx=0).stop 2024-09-10T11:52:42.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 -- 172.21.15.78:0/44001181 shutdown_connections 2024-09-10T11:52:42.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/44001181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a980b2930 0x7f5a980b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/44001181 >> v2:172.21.15.112:3300/0 conn(0x7f5a98072130 0x7f5a9815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/44001181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98157cd0 0x7f5a9815dd40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 -- 172.21.15.78:0/44001181 >> 172.21.15.78:0/44001181 conn(0x7f5a980b18a0 msgr2=0x7f5a980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 -- 172.21.15.78:0/44001181 shutdown_connections 2024-09-10T11:52:42.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 -- 172.21.15.78:0/44001181 wait complete. 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 Processor -- start 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.170+0000 7f5a9fad7640 1 -- start start 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98072130 0x7f5a981f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a980b2930 0x7f5a981515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a98157cd0 0x7f5a98144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9806fd60 con 0x7f5a98072130 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9806fbe0 con 0x7f5a980b2930 2024-09-10T11:52:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9806fee0 con 0x7f5a98157cd0 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98072130 0x7f5a981f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98072130 0x7f5a981f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37650/0 (socket says 172.21.15.78:37650) 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 -- 172.21.15.78:0/3749547414 learned_addr learned my addr 172.21.15.78:0/3749547414 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d072640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a980b2930 0x7f5a981515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9e074640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a98157cd0 0x7f5a98144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 -- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a98157cd0 msgr2=0x7f5a98144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a98157cd0 0x7f5a98144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 -- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a980b2930 msgr2=0x7f5a981515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a980b2930 0x7f5a981515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 -- 172.21.15.78:0/3749547414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9815e870 con 0x7f5a98072130 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9e074640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a98157cd0 0x7f5a98144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d873640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98072130 0x7f5a981f5470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5a900b0040 tx=0x7f5a900a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900b2040 con 0x7f5a98072130 2024-09-10T11:52:42.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a900042c0 con 0x7f5a98072130 2024-09-10T11:52:42.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a90005290 con 0x7f5a98072130 2024-09-10T11:52:42.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a98145160 con 0x7f5a98072130 2024-09-10T11:52:42.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a981f5da0 con 0x7f5a98072130 2024-09-10T11:52:42.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a980b2dc0 con 0x7f5a98072130 2024-09-10T11:52:42.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f5a90005430 con 0x7f5a98072130 2024-09-10T11:52:42.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5a8406f710 0x7f5a84071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5a90129430 con 0x7f5a98072130 2024-09-10T11:52:42.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f5a84077910 0x7f5a84079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 --> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a900b0e70 con 0x7f5a84077910 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a90129860 con 0x7f5a98072130 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9e074640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f5a84077910 0x7f5a84079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.174+0000 7f5a9d072640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5a8406f710 0x7f5a84071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.178+0000 7f5a9e074640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f5a84077910 0x7f5a84079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.178+0000 7f5a9d072640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5a8406f710 0x7f5a84071bd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a980741d0 tx=0x7f5a8c00a4e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.178+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== osd.0 v2:172.21.15.78:6824/1912853801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a900b0e70 con 0x7f5a84077910 2024-09-10T11:52:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 --> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5a9814f340 con 0x7f5a84077910 2024-09-10T11:52:42.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a967fc640 1 -- 172.21.15.78:0/3749547414 <== osd.0 v2:172.21.15.78:6824/1912853801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5a9814f340 con 0x7f5a84077910 2024-09-10T11:52:42.192 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:42.192 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:42.192 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f5a84077910 msgr2=0x7f5a84079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:6824/1912853801,v1:172.21.15.78:6825/1912853801] conn(0x7f5a84077910 0x7f5a84079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5a8406f710 msgr2=0x7f5a84071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f5a8406f710 0x7f5a84071bd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a980741d0 tx=0x7f5a8c00a4e0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98072130 msgr2=0x7f5a981f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 --2- 172.21.15.78:0/3749547414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a98072130 0x7f5a981f5470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5a900b0040 tx=0x7f5a900a5680 comp rx=0 tx=0).stop 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9e074640 1 -- 172.21.15.78:0/3749547414 reap_dead start 2024-09-10T11:52:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 shutdown_connections 2024-09-10T11:52:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 >> 172.21.15.78:0/3749547414 conn(0x7f5a980b18a0 msgr2=0x7f5a980b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 shutdown_connections 2024-09-10T11:52:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.190+0000 7f5a9fad7640 1 -- 172.21.15.78:0/3749547414 wait complete. 2024-09-10T11:52:42.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T11:52:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 -- 172.21.15.78:0/2932359441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d40cf220 msgr2=0x7fb2d40cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 --2- 172.21.15.78:0/2932359441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d40cf220 0x7fb2d40cc150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4074340 tx=0x7fb2d001caf0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 -- 172.21.15.78:0/2932359441 shutdown_connections 2024-09-10T11:52:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 --2- 172.21.15.78:0/2932359441 >> v2:172.21.15.112:3300/0 conn(0x7fb2d415fbd0 0x7fb2d40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 --2- 172.21.15.78:0/2932359441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d40cf220 0x7fb2d40cc150 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 -- 172.21.15.78:0/2932359441 >> 172.21.15.78:0/2932359441 conn(0x7fb2d40b1490 msgr2=0x7fb2d40b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 -- 172.21.15.78:0/2932359441 shutdown_connections 2024-09-10T11:52:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.322+0000 7fb2db9ce640 1 -- 172.21.15.78:0/2932359441 wait complete. 2024-09-10T11:52:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 Processor -- start 2024-09-10T11:52:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 -- start start 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d4073450 0x7fb2d4148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d40cf220 0x7fb2d41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 0x7fb2d41475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d406f2a0 con 0x7fb2d415fbd0 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d406f120 con 0x7fb2d4073450 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d406f420 con 0x7fb2d40cf220 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 0x7fb2d41475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 0x7fb2d41475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37668/0 (socket says 172.21.15.78:37668) 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 -- 172.21.15.78:0/4073334076 learned_addr learned my addr 172.21.15.78:0/4073334076 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d976a640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d4073450 0x7fb2d4148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d8f69640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d40cf220 0x7fb2d41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 -- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d40cf220 msgr2=0x7fb2d41470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d40cf220 0x7fb2d41470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 -- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d4073450 msgr2=0x7fb2d4148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d4073450 0x7fb2d4148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 -- 172.21.15.78:0/4073334076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d4153340 con 0x7fb2d415fbd0 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d8f69640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d40cf220 0x7fb2d41470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2d9f6b640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 0x7fb2d41475f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c970 tx=0x7fb2cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc007bb0 con 0x7fb2d415fbd0 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 -- 172.21.15.78:0/4073334076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d414eed0 con 0x7fb2d415fbd0 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2db9ce640 1 -- 172.21.15.78:0/4073334076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d4148f70 con 0x7fb2d415fbd0 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2cc007d50 con 0x7fb2d415fbd0 2024-09-10T11:52:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.326+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00f6b0 con 0x7fb2d415fbd0 2024-09-10T11:52:42.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.330+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d406fa30 con 0x7fb2d415fbd0 2024-09-10T11:52:42.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.330+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb2cc0213f0 con 0x7fb2d415fbd0 2024-09-10T11:52:42.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.330+0000 7fb2c9ffb640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb2b806f710 0x7fb2b8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.330+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb2cc08ff20 con 0x7fb2d415fbd0 2024-09-10T11:52:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.330+0000 7fb2d976a640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb2b806f710 0x7fb2b8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.330+0000 7fb2d976a640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb2b806f710 0x7fb2b8071bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00af000 tx=0x7fb2d001b330 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.334+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb2cc014030 con 0x7fb2d415fbd0 2024-09-10T11:52:42.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.482+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb2d40b22c0 con 0x7fb2b806f710 2024-09-10T11:52:42.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.482+0000 7fb2c9ffb640 1 -- 172.21.15.78:0/4073334076 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2d40b22c0 con 0x7fb2b806f710 2024-09-10T11:52:42.484 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb2b806f710 msgr2=0x7fb2b8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb2b806f710 0x7fb2b8071bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00af000 tx=0x7fb2d001b330 comp rx=0 tx=0).stop 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 msgr2=0x7fb2d41475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 0x7fb2d41475f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c970 tx=0x7fb2cc00ce30 comp rx=0 tx=0).stop 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 shutdown_connections 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb2b806f710 0x7fb2b8071bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d415fbd0 0x7fb2d41475f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d40cf220 0x7fb2d41470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 --2- 172.21.15.78:0/4073334076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d4073450 0x7fb2d4148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 >> 172.21.15.78:0/4073334076 conn(0x7fb2d40b1490 msgr2=0x7fb2d415e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 shutdown_connections 2024-09-10T11:52:42.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.486+0000 7fb2bf7fe640 1 -- 172.21.15.78:0/4073334076 wait complete. 2024-09-10T11:52:42.502 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T11:52:42.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 -- 172.21.15.78:0/143637000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 msgr2=0x7f12e0073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 --2- 172.21.15.78:0/143637000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e0073680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f12e00d1530 tx=0x7f12d001cd80 comp rx=0 tx=0).stop 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 -- 172.21.15.78:0/143637000 shutdown_connections 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 --2- 172.21.15.78:0/143637000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e0073680 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 --2- 172.21.15.78:0/143637000 >> v2:172.21.15.112:3300/0 conn(0x7f12e0070290 0x7f12e00706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 --2- 172.21.15.78:0/143637000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e0154f50 0x7f12e00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 -- 172.21.15.78:0/143637000 >> 172.21.15.78:0/143637000 conn(0x7f12e00d08d0 msgr2=0x7f12e00d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 -- 172.21.15.78:0/143637000 shutdown_connections 2024-09-10T11:52:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.618+0000 7f12e7340640 1 -- 172.21.15.78:0/143637000 wait complete. 2024-09-10T11:52:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 Processor -- start 2024-09-10T11:52:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- start start 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e0070290 0x7f12e01543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e01473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e0154f50 0x7f12e014e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f12e006f300 con 0x7f12e00731f0 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12e006f180 con 0x7f12e0070290 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f12e006f480 con 0x7f12e0154f50 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e01473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e01473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37682/0 (socket says 172.21.15.78:37682) 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 -- 172.21.15.78:0/280238152 learned_addr learned my addr 172.21.15.78:0/280238152 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e58dd640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e0154f50 0x7f12e014e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e50dc640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e0070290 0x7f12e01543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 -- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e0154f50 msgr2=0x7f12e014e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e0154f50 0x7f12e014e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 -- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e0070290 msgr2=0x7f12e01543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e0070290 0x7f12e01543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 -- 172.21.15.78:0/280238152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e014e930 con 0x7f12e00731f0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e48db640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e01473c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f12d400b4b0 tx=0x7f12d400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4014070 con 0x7f12e00731f0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12d4010610 con 0x7f12e00731f0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4010a80 con 0x7f12e00731f0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e0154a30 con 0x7f12e00731f0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e0148910 con 0x7f12e00731f0 2024-09-10T11:52:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.622+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12e0073680 con 0x7f12e00731f0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f12d4017070 con 0x7f12e00731f0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f12cc06f710 0x7f12cc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f12d408f710 con 0x7f12e00731f0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7f12cc077910 0x7f12cc079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 --> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12cc07a400 con 0x7f12cc077910 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f12d408fb40 con 0x7f12e00731f0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12e50dc640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f12cc06f710 0x7f12cc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12e58dd640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7f12cc077910 0x7f12cc079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12e58dd640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7f12cc077910 0x7f12cc079d30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12e50dc640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f12cc06f710 0x7f12cc071bd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f12e015b820 tx=0x7f12d8008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.626+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== osd.1 v2:172.21.15.78:6800/672081061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f12cc07a400 con 0x7f12cc077910 2024-09-10T11:52:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 --> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f12e0073f70 con 0x7f12cc077910 2024-09-10T11:52:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12ddffb640 1 -- 172.21.15.78:0/280238152 <== osd.1 v2:172.21.15.78:6800/672081061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f12e0073f70 con 0x7f12cc077910 2024-09-10T11:52:42.640 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:42.641 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:42.641 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7f12cc077910 msgr2=0x7f12cc079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:6800/672081061,v1:172.21.15.78:6801/672081061] conn(0x7f12cc077910 0x7f12cc079d30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f12cc06f710 msgr2=0x7f12cc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f12cc06f710 0x7f12cc071bd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f12e015b820 tx=0x7f12d8008040 comp rx=0 tx=0).stop 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 msgr2=0x7f12e01473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 --2- 172.21.15.78:0/280238152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e00731f0 0x7f12e01473c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f12d400b4b0 tx=0x7f12d400b970 comp rx=0 tx=0).stop 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e58dd640 1 -- 172.21.15.78:0/280238152 reap_dead start 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 shutdown_connections 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 >> 172.21.15.78:0/280238152 conn(0x7f12e00d08d0 msgr2=0x7f12e006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 shutdown_connections 2024-09-10T11:52:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.638+0000 7f12e7340640 1 -- 172.21.15.78:0/280238152 wait complete. 2024-09-10T11:52:42.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 -- 172.21.15.78:0/2237409773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d4330 msgr2=0x7f8d1c0ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 --2- 172.21.15.78:0/2237409773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c0ceaf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0d16b0 tx=0x7f8d1401cd80 comp rx=0 tx=0).stop 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 -- 172.21.15.78:0/2237409773 shutdown_connections 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 --2- 172.21.15.78:0/2237409773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c0ceaf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 --2- 172.21.15.78:0/2237409773 >> v2:172.21.15.112:3300/0 conn(0x7f8d1c0d28f0 0x7f8d1c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 -- 172.21.15.78:0/2237409773 >> 172.21.15.78:0/2237409773 conn(0x7f8d1c09ce30 msgr2=0x7f8d1c0d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 -- 172.21.15.78:0/2237409773 shutdown_connections 2024-09-10T11:52:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 -- 172.21.15.78:0/2237409773 wait complete. 2024-09-10T11:52:42.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 Processor -- start 2024-09-10T11:52:42.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 -- start start 2024-09-10T11:52:42.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.762+0000 7f8d23ead640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 0x7f8d1c0b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c161410 0x7f8d1c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c16ae50 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c16acd0 con 0x7f8d1c0d4330 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c16afd0 con 0x7f8d1c161410 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 0x7f8d1c0b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 0x7f8d1c0b8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37700/0 (socket says 172.21.15.78:37700) 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 -- 172.21.15.78:0/1930094979 learned_addr learned my addr 172.21.15.78:0/1930094979 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21448640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 -- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c161410 msgr2=0x7f8d1c15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d2244a640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c161410 0x7f8d1c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c161410 0x7f8d1c15cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 -- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c0d4330 msgr2=0x7f8d1c15c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c15c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 -- 172.21.15.78:0/1930094979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c1f74d0 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21448640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c15c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21c49640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 0x7f8d1c0b8f00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b3e0 tx=0x7f8d0c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c015020 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d0c011940 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c1f7770 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c011d90 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1f7d30 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c0ceaf0 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f8d0c018020 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d127fc640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d0006f710 0x7f8d00071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8d0c08f710 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21448640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d0006f710 0x7f8d00071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.766+0000 7f8d21448640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d0006f710 0x7f8d00071bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d18005fd0 tx=0x7f8d18005d40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:42.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.770+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f8d0c01f020 con 0x7f8d1c0d28f0 2024-09-10T11:52:42.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.914+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8d1c15b6a0 con 0x7f8d0006f710 2024-09-10T11:52:42.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.914+0000 7f8d127fc640 1 -- 172.21.15.78:0/1930094979 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8d1c15b6a0 con 0x7f8d0006f710 2024-09-10T11:52:42.916 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T11:52:42.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d0006f710 msgr2=0x7f8d00071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d0006f710 0x7f8d00071bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d18005fd0 tx=0x7f8d18005d40 comp rx=0 tx=0).stop 2024-09-10T11:52:42.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 msgr2=0x7f8d1c0b8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:42.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 0x7f8d1c0b8f00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b3e0 tx=0x7f8d0c00b8a0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 shutdown_connections 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c0d4330 0x7f8d1c15c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8d0006f710 0x7f8d00071bd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c161410 0x7f8d1c15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 --2- 172.21.15.78:0/1930094979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c0d28f0 0x7f8d1c0b8f00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 >> 172.21.15.78:0/1930094979 conn(0x7f8d1c09ce30 msgr2=0x7f8d1c06e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 shutdown_connections 2024-09-10T11:52:42.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:42.918+0000 7f8d23ead640 1 -- 172.21.15.78:0/1930094979 wait complete. 2024-09-10T11:52:42.935 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T11:52:42.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 -- 172.21.15.78:0/2376983719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c15b9e0 msgr2=0x7f9e8c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 --2- 172.21.15.78:0/2376983719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c15b9e0 0x7f9e8c0cf5b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c15f390 tx=0x7f9e7c01cac0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 -- 172.21.15.78:0/2376983719 shutdown_connections 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 --2- 172.21.15.78:0/2376983719 >> v2:172.21.15.112:3300/0 conn(0x7f9e8c071680 0x7f9e8c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 --2- 172.21.15.78:0/2376983719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c15b9e0 0x7f9e8c0cf5b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 -- 172.21.15.78:0/2376983719 >> 172.21.15.78:0/2376983719 conn(0x7f9e8c0d08d0 msgr2=0x7f9e8c0d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 -- 172.21.15.78:0/2376983719 shutdown_connections 2024-09-10T11:52:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.050+0000 7f9e924bc640 1 -- 172.21.15.78:0/2376983719 wait complete. 2024-09-10T11:52:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 Processor -- start 2024-09-10T11:52:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- start start 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c06ce90 0x7f9e8c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c071680 0x7f9e8c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c15b9e0 0x7f9e8c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c168a20 con 0x7f9e8c071680 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c1688a0 con 0x7f9e8c15b9e0 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c168ba0 con 0x7f9e8c06ce90 2024-09-10T11:52:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c071680 0x7f9e8c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c071680 0x7f9e8c15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37726/0 (socket says 172.21.15.78:37726) 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 -- 172.21.15.78:0/1102224954 learned_addr learned my addr 172.21.15.78:0/1102224954 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 -- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c06ce90 msgr2=0x7f9e8c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c06ce90 0x7f9e8c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 -- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c15b9e0 msgr2=0x7f9e8c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c15b9e0 0x7f9e8c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 -- 172.21.15.78:0/1102224954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c1f7c20 con 0x7f9e8c071680 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e8b7fe640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c071680 0x7f9e8c15a4d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400c970 tx=0x7f9e7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74007c70 con 0x7f9e8c071680 2024-09-10T11:52:43.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e7400f450 con 0x7f9e8c071680 2024-09-10T11:52:43.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c1f7f00 con 0x7f9e8c071680 2024-09-10T11:52:43.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400f8a0 con 0x7f9e8c071680 2024-09-10T11:52:43.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c1f84c0 con 0x7f9e8c071680 2024-09-10T11:52:43.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e8c06c950 con 0x7f9e8c071680 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f9e74018400 con 0x7f9e8c071680 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e88ff9640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9e6c06f710 0x7f9e6c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.054+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9e74090780 con 0x7f9e8c071680 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e88ff9640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f9e6c077910 0x7f9e6c079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 --> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e6c07a400 con 0x7f9e6c077910 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9e74090bb0 con 0x7f9e8c071680 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e8bfff640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9e6c06f710 0x7f9e6c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e90a59640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f9e6c077910 0x7f9e6c079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e90a59640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f9e6c077910 0x7f9e6c079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e8bfff640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9e6c06f710 0x7f9e6c071bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0af000 tx=0x7f9e7c019860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.058+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== osd.2 v2:172.21.15.78:6816/3600861345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e6c07a400 con 0x7f9e6c077910 2024-09-10T11:52:43.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 --> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e8c1fae10 con 0x7f9e6c077910 2024-09-10T11:52:43.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e88ff9640 1 -- 172.21.15.78:0/1102224954 <== osd.2 v2:172.21.15.78:6816/3600861345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e8c1fae10 con 0x7f9e6c077910 2024-09-10T11:52:43.071 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:43.071 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:43.072 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:43.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f9e6c077910 msgr2=0x7f9e6c079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:6816/3600861345,v1:172.21.15.78:6817/3600861345] conn(0x7f9e6c077910 0x7f9e6c079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9e6c06f710 msgr2=0x7f9e6c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f9e6c06f710 0x7f9e6c071bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0af000 tx=0x7f9e7c019860 comp rx=0 tx=0).stop 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c071680 msgr2=0x7f9e8c15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 --2- 172.21.15.78:0/1102224954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c071680 0x7f9e8c15a4d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400c970 tx=0x7f9e7400ce30 comp rx=0 tx=0).stop 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e90a59640 1 -- 172.21.15.78:0/1102224954 reap_dead start 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 shutdown_connections 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 >> 172.21.15.78:0/1102224954 conn(0x7f9e8c0d08d0 msgr2=0x7f9e8c06f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 shutdown_connections 2024-09-10T11:52:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.070+0000 7f9e924bc640 1 -- 172.21.15.78:0/1102224954 wait complete. 2024-09-10T11:52:43.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T11:52:43.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 -- 172.21.15.78:0/3613674147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 msgr2=0x7f5968003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 --2- 172.21.15.78:0/3613674147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f5968003e30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f597000c610 tx=0x7f597001d310 comp rx=0 tx=0).stop 2024-09-10T11:52:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f5985dfb640 1 -- 172.21.15.78:0/3613674147 reap_dead start 2024-09-10T11:52:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 -- 172.21.15.78:0/3613674147 shutdown_connections 2024-09-10T11:52:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 -- 172.21.15.78:0/3613674147 >> 172.21.15.78:0/3613674147 conn(0x7f59800d3c80 msgr2=0x7f59800d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 -- 172.21.15.78:0/3613674147 shutdown_connections 2024-09-10T11:52:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 -- 172.21.15.78:0/3613674147 wait complete. 2024-09-10T11:52:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 Processor -- start 2024-09-10T11:52:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.194+0000 7f598785e640 1 -- start start 2024-09-10T11:52:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f59801fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5980146a60 0x7f59800cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f7f90 0x7f59801f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5980168c40 con 0x7f5968003a10 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5980168ac0 con 0x7f59801f7f90 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5980168dc0 con 0x7f5980146a60 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f59801fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f59801fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37752/0 (socket says 172.21.15.78:37752) 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 -- 172.21.15.78:0/133383882 learned_addr learned my addr 172.21.15.78:0/133383882 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f5984df9640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5980146a60 0x7f59800cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 -- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5980146a60 msgr2=0x7f59800cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5980146a60 0x7f59800cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 -- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f7f90 msgr2=0x7f59801f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f7f90 0x7f59801f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 -- 172.21.15.78:0/133383882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5980143440 con 0x7f5968003a10 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f59855fa640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f59801fb960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5970098ee0 tx=0x7f597000c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970004a10 con 0x7f5968003a10 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5970004bb0 con 0x7f5968003a10 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59801436e0 con 0x7f5968003a10 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970006090 con 0x7f5968003a10 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59801fb160 con 0x7f5968003a10 2024-09-10T11:52:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59800b8a90 con 0x7f5968003a10 2024-09-10T11:52:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f59700b8030 con 0x7f5968003a10 2024-09-10T11:52:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f597dffb640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f596c06f710 0x7f596c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f59701293c0 con 0x7f5968003a10 2024-09-10T11:52:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f5984df9640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f596c06f710 0x7f596c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.198+0000 7f5984df9640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f596c06f710 0x7f596c071bd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5974005fd0 tx=0x7f5974005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.202+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f59700a8070 con 0x7f5968003a10 2024-09-10T11:52:43.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.338+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f59800b84d0 con 0x7f596c06f710 2024-09-10T11:52:43.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.338+0000 7f597dffb640 1 -- 172.21.15.78:0/133383882 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59800b84d0 con 0x7f596c06f710 2024-09-10T11:52:43.341 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f596c06f710 msgr2=0x7f596c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f596c06f710 0x7f596c071bd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5974005fd0 tx=0x7f5974005f40 comp rx=0 tx=0).stop 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 msgr2=0x7f59801fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f59801fb960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5970098ee0 tx=0x7f597000c260 comp rx=0 tx=0).stop 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 shutdown_connections 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f7f90 0x7f59801f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f596c06f710 0x7f596c071bd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5980146a60 0x7f59800cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 --2- 172.21.15.78:0/133383882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968003a10 0x7f59801fb960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 >> 172.21.15.78:0/133383882 conn(0x7f59800d3c80 msgr2=0x7f598015bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 shutdown_connections 2024-09-10T11:52:43.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.342+0000 7f598785e640 1 -- 172.21.15.78:0/133383882 wait complete. 2024-09-10T11:52:43.357 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T11:52:43.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/760118358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 msgr2=0x7fea8415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 --2- 172.21.15.78:0/760118358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 0x7fea8415dd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea8000a950 tx=0x7fea8001dab0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/760118358 shutdown_connections 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 --2- 172.21.15.78:0/760118358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea84072130 0x7fea8415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 --2- 172.21.15.78:0/760118358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 0x7fea8415dd40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/760118358 >> 172.21.15.78:0/760118358 conn(0x7fea840b18a0 msgr2=0x7fea840b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/760118358 shutdown_connections 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/760118358 wait complete. 2024-09-10T11:52:43.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 Processor -- start 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- start start 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea84072130 0x7fea840cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea840b2930 0x7fea841569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 0x7fea84072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fea8406ff30 con 0x7fea84072130 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea8406fdb0 con 0x7fea84157cd0 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fea840700b0 con 0x7fea840b2930 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea84072130 0x7fea840cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea84072130 0x7fea840cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37762/0 (socket says 172.21.15.78:37762) 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 -- 172.21.15.78:0/3505551803 learned_addr learned my addr 172.21.15.78:0/3505551803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a993640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 0x7fea84072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea89991640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea840b2930 0x7fea841569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 -- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea840b2930 msgr2=0x7fea841569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea840b2930 0x7fea841569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 -- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 msgr2=0x7fea84072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 0x7fea84072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 -- 172.21.15.78:0/3505551803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea840cdeb0 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a993640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea84157cd0 0x7fea84072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8a192640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea84072130 0x7fea840cd680 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea8001e350 tx=0x7fea80005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea800b3040 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea80005230 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea84155ef0 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea800046d0 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea840cdbc0 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.478+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea841562e0 con 0x7fea84072130 2024-09-10T11:52:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fea80004870 con 0x7fea84072130 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fea6806f710 0x7fea68071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fea8012a440 con 0x7fea84072130 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fea68077910 0x7fea68079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 --> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea8000c1c0 con 0x7fea68077910 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea8012a870 con 0x7fea84072130 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea8a993640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fea68077910 0x7fea68079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea89991640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fea6806f710 0x7fea68071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea8a993640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fea68077910 0x7fea68079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea89991640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fea6806f710 0x7fea68071bd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea74009600 tx=0x7fea740091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.482+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== osd.3 v2:172.21.15.78:6808/1722253124 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea8000c1c0 con 0x7fea68077910 2024-09-10T11:52:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 --> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fea840b2dc0 con 0x7fea68077910 2024-09-10T11:52:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea7affd640 1 -- 172.21.15.78:0/3505551803 <== osd.3 v2:172.21.15.78:6808/1722253124 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fea840b2dc0 con 0x7fea68077910 2024-09-10T11:52:43.497 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:43.497 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:43.497 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fea68077910 msgr2=0x7fea68079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:6808/1722253124,v1:172.21.15.78:6809/1722253124] conn(0x7fea68077910 0x7fea68079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fea6806f710 msgr2=0x7fea68071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fea6806f710 0x7fea68071bd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea74009600 tx=0x7fea740091e0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea84072130 msgr2=0x7fea840cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 --2- 172.21.15.78:0/3505551803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea84072130 0x7fea840cd680 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea8001e350 tx=0x7fea80005d20 comp rx=0 tx=0).stop 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8a993640 1 -- 172.21.15.78:0/3505551803 reap_dead start 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 shutdown_connections 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 >> 172.21.15.78:0/3505551803 conn(0x7fea840b18a0 msgr2=0x7fea840b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 shutdown_connections 2024-09-10T11:52:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.494+0000 7fea8c3f6640 1 -- 172.21.15.78:0/3505551803 wait complete. 2024-09-10T11:52:43.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T11:52:43.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- 172.21.15.78:0/2767755743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb524003a10 msgr2=0x7fb524003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 --2- 172.21.15.78:0/2767755743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb524003a10 0x7fb524003e30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb534009b30 tx=0x7fb53401d190 comp rx=0 tx=0).stop 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb53ecd7640 1 -- 172.21.15.78:0/2767755743 reap_dead start 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- 172.21.15.78:0/2767755743 shutdown_connections 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- 172.21.15.78:0/2767755743 >> 172.21.15.78:0/2767755743 conn(0x7fb5380b1490 msgr2=0x7fb5380b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- 172.21.15.78:0/2767755743 shutdown_connections 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- 172.21.15.78:0/2767755743 wait complete. 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 Processor -- start 2024-09-10T11:52:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- start start 2024-09-10T11:52:43.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524003a10 0x7fb538153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 0x7fb538154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb538148610 0x7fb538154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb53806f4b0 con 0x7fb5381481b0 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5380af240 con 0x7fb524003a10 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb54073a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb53806f630 con 0x7fb538148610 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb53dcd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 0x7fb538154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb53dcd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 0x7fb538154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37782/0 (socket says 172.21.15.78:37782) 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.626+0000 7fb53dcd5640 1 -- 172.21.15.78:0/4218176176 learned_addr learned my addr 172.21.15.78:0/4218176176 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53e4d6640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524003a10 0x7fb538153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53ecd7640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb538148610 0x7fb538154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53dcd5640 1 -- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb538148610 msgr2=0x7fb538154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53dcd5640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb538148610 0x7fb538154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53dcd5640 1 -- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524003a10 msgr2=0x7fb538153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53dcd5640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524003a10 0x7fb538153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53dcd5640 1 -- 172.21.15.78:0/4218176176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5381f7010 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53e4d6640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524003a10 0x7fb538153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53dcd5640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 0x7fb538154870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb52800f950 tx=0x7fb52800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528015070 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb52801a460 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52800be60 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb538153090 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb538153650 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53815f4c0 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fb52801a870 con 0x7fb5381481b0 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb52effd640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb51c06f740 0x7fb51c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb528090790 con 0x7fb5381481b0 2024-09-10T11:52:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53e4d6640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb51c06f740 0x7fb51c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.630+0000 7fb53e4d6640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb51c06f740 0x7fb51c071c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5340ae000 tx=0x7fb534019f30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.634+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fb52805d740 con 0x7fb5381481b0 2024-09-10T11:52:43.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.770+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb5381f72f0 con 0x7fb51c06f740 2024-09-10T11:52:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.770+0000 7fb52effd640 1 -- 172.21.15.78:0/4218176176 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb5381f72f0 con 0x7fb51c06f740 2024-09-10T11:52:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T11:52:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb51c06f740 msgr2=0x7fb51c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb51c06f740 0x7fb51c071c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5340ae000 tx=0x7fb534019f30 comp rx=0 tx=0).stop 2024-09-10T11:52:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 msgr2=0x7fb538154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 0x7fb538154870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb52800f950 tx=0x7fb52800fe10 comp rx=0 tx=0).stop 2024-09-10T11:52:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 shutdown_connections 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fb51c06f740 0x7fb51c071c00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb538148610 0x7fb538154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5381481b0 0x7fb538154870 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 --2- 172.21.15.78:0/4218176176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524003a10 0x7fb538153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 >> 172.21.15.78:0/4218176176 conn(0x7fb5380b1490 msgr2=0x7fb538160580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 shutdown_connections 2024-09-10T11:52:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.774+0000 7fb54073a640 1 -- 172.21.15.78:0/4218176176 wait complete. 2024-09-10T11:52:43.790 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T11:52:43.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:43.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 -- 172.21.15.78:0/3069198130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140b3370 msgr2=0x7f95140b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 --2- 172.21.15.78:0/3069198130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140b3370 0x7f95140b3820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f950c009bc0 tx=0x7f950c01cb70 comp rx=0 tx=0).stop 2024-09-10T11:52:43.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 -- 172.21.15.78:0/3069198130 shutdown_connections 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 --2- 172.21.15.78:0/3069198130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140b3370 0x7f95140b3820 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 --2- 172.21.15.78:0/3069198130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f951406d5b0 0x7f95140aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 -- 172.21.15.78:0/3069198130 >> 172.21.15.78:0/3069198130 conn(0x7f95140b18a0 msgr2=0x7f95140b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 -- 172.21.15.78:0/3069198130 shutdown_connections 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 -- 172.21.15.78:0/3069198130 wait complete. 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.914+0000 7f951b98d640 1 Processor -- start 2024-09-10T11:52:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- start start 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f951406d5b0 0x7f951414be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140ae9d0 0x7f9514146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95140b3370 0x7f951414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95141678e0 con 0x7f95140b3370 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9514167760 con 0x7f95140ae9d0 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9514167a60 con 0x7f951406d5b0 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95140b3370 0x7f951414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95140b3370 0x7f951414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37790/0 (socket says 172.21.15.78:37790) 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 -- 172.21.15.78:0/3360733843 learned_addr learned my addr 172.21.15.78:0/3360733843 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519729640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f951406d5b0 0x7f951414be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9518f28640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140ae9d0 0x7f9514146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 -- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f951406d5b0 msgr2=0x7f951414be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f951406d5b0 0x7f951414be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 -- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140ae9d0 msgr2=0x7f9514146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140ae9d0 0x7f9514146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 -- 172.21.15.78:0/3360733843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951414ad70 con 0x7f95140b3370 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519729640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f951406d5b0 0x7f951414be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9518f28640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95140ae9d0 0x7f9514146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9519f2a640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95140b3370 0x7f951414a2b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f950c01a7a0 tx=0x7f950c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c0b2040 con 0x7f95140b3370 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951414b050 con 0x7f95140b3370 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f950c004d40 con 0x7f95140b3370 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c004240 con 0x7f95140b3370 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951414b610 con 0x7f95140b3370 2024-09-10T11:52:43.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95140aedb0 con 0x7f95140b3370 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f950c0be060 con 0x7f95140b3370 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.918+0000 7f9509ffb640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f94f806f710 0x7f94f8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f950c129de0 con 0x7f95140b3370 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9509ffb640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f94f8077910 0x7f94f8079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 --> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94f807a400 con 0x7f94f8077910 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f950c12a210 con 0x7f95140b3370 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9519729640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f94f806f710 0x7f94f8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9518f28640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f94f8077910 0x7f94f8079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9519729640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f94f806f710 0x7f94f8071bd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9514155400 tx=0x7f9510009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9518f28640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f94f8077910 0x7f94f8079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:43.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.922+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== osd.4 v2:172.21.15.112:6826/1513593239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94f807a400 con 0x7f94f8077910 2024-09-10T11:52:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.934+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 --> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f95140b0ae0 con 0x7f94f8077910 2024-09-10T11:52:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f9509ffb640 1 -- 172.21.15.78:0/3360733843 <== osd.4 v2:172.21.15.112:6826/1513593239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f95140b0ae0 con 0x7f94f8077910 2024-09-10T11:52:43.938 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:43.938 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:43.938 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f94f8077910 msgr2=0x7f94f8079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6826/1513593239,v1:172.21.15.112:6827/1513593239] conn(0x7f94f8077910 0x7f94f8079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f94f806f710 msgr2=0x7f94f8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f94f806f710 0x7f94f8071bd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9514155400 tx=0x7f9510009040 comp rx=0 tx=0).stop 2024-09-10T11:52:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95140b3370 msgr2=0x7f951414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 --2- 172.21.15.78:0/3360733843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95140b3370 0x7f951414a2b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f950c01a7a0 tx=0x7f950c009300 comp rx=0 tx=0).stop 2024-09-10T11:52:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f9519f2a640 1 -- 172.21.15.78:0/3360733843 reap_dead start 2024-09-10T11:52:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 shutdown_connections 2024-09-10T11:52:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 >> 172.21.15.78:0/3360733843 conn(0x7f95140b18a0 msgr2=0x7f95140ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 shutdown_connections 2024-09-10T11:52:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:43.938+0000 7f951b98d640 1 -- 172.21.15.78:0/3360733843 wait complete. 2024-09-10T11:52:43.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T11:52:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 -- 172.21.15.78:0/3816313343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 msgr2=0x7fcbd80ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/3816313343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd80ae510 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009900 tx=0x7fcbd001c8e0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 -- 172.21.15.78:0/3816313343 shutdown_connections 2024-09-10T11:52:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/3816313343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd80ae510 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/3816313343 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 0x7fcbd80cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 -- 172.21.15.78:0/3816313343 >> 172.21.15.78:0/3816313343 conn(0x7fcbd80b1490 msgr2=0x7fcbd80b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 -- 172.21.15.78:0/3816313343 shutdown_connections 2024-09-10T11:52:44.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 -- 172.21.15.78:0/3816313343 wait complete. 2024-09-10T11:52:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 Processor -- start 2024-09-10T11:52:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.066+0000 7fcbdfd01640 1 -- start start 2024-09-10T11:52:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd8148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd80cf220 0x7fcbd815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 0x7fcbd815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd806f310 con 0x7fcbd8073450 2024-09-10T11:52:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd806f190 con 0x7fcbd80cf220 2024-09-10T11:52:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd806f490 con 0x7fcbd815fbd0 2024-09-10T11:52:44.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd8148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd8148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37804/0 (socket says 172.21.15.78:37804) 2024-09-10T11:52:44.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 -- 172.21.15.78:0/2845489691 learned_addr learned my addr 172.21.15.78:0/2845489691 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:44.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdd29c640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd80cf220 0x7fcbd815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbde29e640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 0x7fcbd815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 -- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 msgr2=0x7fcbd815d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 0x7fcbd815d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 -- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd80cf220 msgr2=0x7fcbd815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd80cf220 0x7fcbd815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 -- 172.21.15.78:0/2845489691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd80b2930 con 0x7fcbd8073450 2024-09-10T11:52:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbde29e640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 0x7fcbd815d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdda9d640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd8148920 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c8a0 tx=0x7fcbd400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4003b80 con 0x7fcbd8073450 2024-09-10T11:52:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbd4003d20 con 0x7fcbd8073450 2024-09-10T11:52:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd80b2ba0 con 0x7fcbd8073450 2024-09-10T11:52:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400aab0 con 0x7fcbd8073450 2024-09-10T11:52:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd8152860 con 0x7fcbd8073450 2024-09-10T11:52:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd806fa20 con 0x7fcbd8073450 2024-09-10T11:52:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fcbd400ac50 con 0x7fcbd8073450 2024-09-10T11:52:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbce7fc640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbbc06f710 0x7fcbbc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fcbd408f6e0 con 0x7fcbd8073450 2024-09-10T11:52:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.070+0000 7fcbdd29c640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbbc06f710 0x7fcbbc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.074+0000 7fcbdd29c640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbbc06f710 0x7fcbbc071bd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbd81fadf0 tx=0x7fcbc8005dd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.074+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fcbd806e7e0 con 0x7fcbd8073450 2024-09-10T11:52:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.210+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcbd80cbda0 con 0x7fcbbc06f710 2024-09-10T11:52:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbce7fc640 1 -- 172.21.15.78:0/2845489691 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcbd80cbda0 con 0x7fcbbc06f710 2024-09-10T11:52:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T11:52:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbbc06f710 msgr2=0x7fcbbc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbbc06f710 0x7fcbbc071bd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbd81fadf0 tx=0x7fcbc8005dd0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 msgr2=0x7fcbd8148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd8148920 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c8a0 tx=0x7fcbd400cd60 comp rx=0 tx=0).stop 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 shutdown_connections 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd80cf220 0x7fcbd815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fcbbc06f710 0x7fcbbc071bd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd815fbd0 0x7fcbd815d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 --2- 172.21.15.78:0/2845489691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbd8073450 0x7fcbd8148920 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 >> 172.21.15.78:0/2845489691 conn(0x7fcbd80b1490 msgr2=0x7fcbd814bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 shutdown_connections 2024-09-10T11:52:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.214+0000 7fcbdfd01640 1 -- 172.21.15.78:0/2845489691 wait complete. 2024-09-10T11:52:44.231 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T11:52:44.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 -- 172.21.15.78:0/1325566908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd0003a40 msgr2=0x7f2fd0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 --2- 172.21.15.78:0/1325566908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd0003a40 0x7f2fd0003e40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c2e0 tx=0x7f2fd401cf50 comp rx=0 tx=0).stop 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe3fff640 1 -- 172.21.15.78:0/1325566908 reap_dead start 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 -- 172.21.15.78:0/1325566908 shutdown_connections 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 -- 172.21.15.78:0/1325566908 >> 172.21.15.78:0/1325566908 conn(0x7f2fe40b18a0 msgr2=0x7f2fe40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 -- 172.21.15.78:0/1325566908 shutdown_connections 2024-09-10T11:52:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 -- 172.21.15.78:0/1325566908 wait complete. 2024-09-10T11:52:44.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 Processor -- start 2024-09-10T11:52:44.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.362+0000 7f2fe9b60640 1 -- start start 2024-09-10T11:52:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd0003a40 0x7f2fe414a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe41495d0 0x7f2fe4148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40afe30 0x7f2fe40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4167e80 con 0x7f2fe40afe30 2024-09-10T11:52:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4167d00 con 0x7f2fd0003a40 2024-09-10T11:52:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe4168000 con 0x7f2fe41495d0 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40afe30 0x7f2fe40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40afe30 0x7f2fe40b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37818/0 (socket says 172.21.15.78:37818) 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 -- 172.21.15.78:0/2360521176 learned_addr learned my addr 172.21.15.78:0/2360521176 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe2ffd640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe41495d0 0x7f2fe4148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe37fe640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd0003a40 0x7f2fe414a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 -- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe41495d0 msgr2=0x7f2fe4148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe41495d0 0x7f2fe4148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 -- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd0003a40 msgr2=0x7f2fe414a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd0003a40 0x7f2fe414a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 -- 172.21.15.78:0/2360521176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe41f8d40 con 0x7f2fe40afe30 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe37fe640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd0003a40 0x7f2fe414a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:52:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe3fff640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40afe30 0x7f2fe40b02b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b3df0 tx=0x7f2fdc00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00dca0 con 0x7f2fe40afe30 2024-09-10T11:52:44.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fdc01a070 con 0x7f2fe40afe30 2024-09-10T11:52:44.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe414b090 con 0x7f2fe40afe30 2024-09-10T11:52:44.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0116a0 con 0x7f2fe40afe30 2024-09-10T11:52:44.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41f92c0 con 0x7f2fe40afe30 2024-09-10T11:52:44.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fe41f96a0 con 0x7f2fe40afe30 2024-09-10T11:52:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f2fdc00c070 con 0x7f2fe40afe30 2024-09-10T11:52:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2fc406f710 0x7f2fc4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2fdc090240 con 0x7f2fe40afe30 2024-09-10T11:52:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7f2fc4077910 0x7f2fc4079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 --> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fdc0020c0 con 0x7f2fc4077910 2024-09-10T11:52:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2fdc090670 con 0x7f2fe40afe30 2024-09-10T11:52:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe37fe640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2fc406f710 0x7f2fc4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.366+0000 7f2fe2ffd640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7f2fc4077910 0x7f2fc4079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.370+0000 7f2fe37fe640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2fc406f710 0x7f2fc4071bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40ab000 tx=0x7f2fd40a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.370+0000 7f2fe2ffd640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7f2fc4077910 0x7f2fc4079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.370+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== osd.5 v2:172.21.15.112:6818/749221931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fdc0020c0 con 0x7f2fc4077910 2024-09-10T11:52:44.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 --> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2fe406ce50 con 0x7f2fc4077910 2024-09-10T11:52:44.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fdbfff640 1 -- 172.21.15.78:0/2360521176 <== osd.5 v2:172.21.15.112:6818/749221931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2fe406ce50 con 0x7f2fc4077910 2024-09-10T11:52:44.385 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:44.385 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:44.385 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7f2fc4077910 msgr2=0x7f2fc4079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6818/749221931,v1:172.21.15.112:6819/749221931] conn(0x7f2fc4077910 0x7f2fc4079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2fc406f710 msgr2=0x7f2fc4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f2fc406f710 0x7f2fc4071bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40ab000 tx=0x7f2fd40a7040 comp rx=0 tx=0).stop 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40afe30 msgr2=0x7f2fe40b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 --2- 172.21.15.78:0/2360521176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40afe30 0x7f2fe40b02b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b3df0 tx=0x7f2fdc00fe10 comp rx=0 tx=0).stop 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe3fff640 1 -- 172.21.15.78:0/2360521176 reap_dead start 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 shutdown_connections 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 >> 172.21.15.78:0/2360521176 conn(0x7f2fe40b18a0 msgr2=0x7f2fe414c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 shutdown_connections 2024-09-10T11:52:44.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.382+0000 7f2fe9b60640 1 -- 172.21.15.78:0/2360521176 wait complete. 2024-09-10T11:52:44.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/763964926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 msgr2=0x7f759c15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 --2- 172.21.15.78:0/763964926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c15ead0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7594009bc0 tx=0x7f759401cb70 comp rx=0 tx=0).stop 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/763964926 shutdown_connections 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 --2- 172.21.15.78:0/763964926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c15ead0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 --2- 172.21.15.78:0/763964926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f759c15a8b0 0x7f759c0ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/763964926 >> 172.21.15.78:0/763964926 conn(0x7f759c0d0990 msgr2=0x7f759c0d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/763964926 shutdown_connections 2024-09-10T11:52:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/763964926 wait complete. 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 Processor -- start 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- start start 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f759c073180 0x7f759c146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f759c15a8b0 0x7f759c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f759c0741d0 con 0x7f759c0735c0 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f759c074050 con 0x7f759c15a8b0 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f759c15f010 con 0x7f759c073180 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37838/0 (socket says 172.21.15.78:37838) 2024-09-10T11:52:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 -- 172.21.15.78:0/1121636700 learned_addr learned my addr 172.21.15.78:0/1121636700 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f759a59c640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f759c073180 0x7f759c146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 -- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f759c073180 msgr2=0x7f759c146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f759c073180 0x7f759c146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 -- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f759c15a8b0 msgr2=0x7f759c157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f759c15a8b0 0x7f759c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 -- 172.21.15.78:0/1121636700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c15d180 con 0x7f759c0735c0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7593fff640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c156df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f758400c450 tx=0x7f758400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584017070 con 0x7f759c0735c0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7584003600 con 0x7f759c0735c0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c0b66c0 con 0x7f759c0735c0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584003a50 con 0x7f759c0735c0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.510+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c15d700 con 0x7f759c0735c0 2024-09-10T11:52:44.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.514+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c0ce560 con 0x7f759c0735c0 2024-09-10T11:52:44.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.514+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f758401a070 con 0x7f759c0735c0 2024-09-10T11:52:44.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.514+0000 7f7592ffd640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f757c06f710 0x7f757c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.514+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f758408eb40 con 0x7f759c0735c0 2024-09-10T11:52:44.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.514+0000 7f759a59c640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f757c06f710 0x7f757c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.514+0000 7f759a59c640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f757c06f710 0x7f757c071bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f758c00b9a0 tx=0x7f758c005c30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.518+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f758405bbb0 con 0x7f759c0735c0 2024-09-10T11:52:44.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.650+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f759c0ce120 con 0x7f757c06f710 2024-09-10T11:52:44.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f7592ffd640 1 -- 172.21.15.78:0/1121636700 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f759c0ce120 con 0x7f757c06f710 2024-09-10T11:52:44.654 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T11:52:44.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f757c06f710 msgr2=0x7f757c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f757c06f710 0x7f757c071bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f758c00b9a0 tx=0x7f758c005c30 comp rx=0 tx=0).stop 2024-09-10T11:52:44.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 msgr2=0x7f759c156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c156df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f758400c450 tx=0x7f758400c910 comp rx=0 tx=0).stop 2024-09-10T11:52:44.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 shutdown_connections 2024-09-10T11:52:44.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f759c15a8b0 0x7f759c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f757c06f710 0x7f757c071bd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759c0735c0 0x7f759c156df0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 --2- 172.21.15.78:0/1121636700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f759c073180 0x7f759c146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 >> 172.21.15.78:0/1121636700 conn(0x7f759c0d0990 msgr2=0x7f759c070920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 shutdown_connections 2024-09-10T11:52:44.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.654+0000 7f75a08b9640 1 -- 172.21.15.78:0/1121636700 wait complete. 2024-09-10T11:52:44.671 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T11:52:44.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 -- 172.21.15.78:0/1391184399 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec0b4050 msgr2=0x7f79ec15b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 --2- 172.21.15.78:0/1391184399 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec0b4050 0x7f79ec15b310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009bf0 tx=0x7f79e401cae0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 -- 172.21.15.78:0/1391184399 shutdown_connections 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 --2- 172.21.15.78:0/1391184399 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec0b4050 0x7f79ec15b310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 --2- 172.21.15.78:0/1391184399 >> v2:172.21.15.112:3300/0 conn(0x7f79ec06d460 0x7f79ec070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 -- 172.21.15.78:0/1391184399 >> 172.21.15.78:0/1391184399 conn(0x7f79ec0b18a0 msgr2=0x7f79ec0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 -- 172.21.15.78:0/1391184399 shutdown_connections 2024-09-10T11:52:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.794+0000 7f79f18eb640 1 -- 172.21.15.78:0/1391184399 wait complete. 2024-09-10T11:52:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 Processor -- start 2024-09-10T11:52:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- start start 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec06d460 0x7f79ec14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec0b3c70 0x7f79ec163ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ec0b4050 0x7f79ec1640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec167e30 con 0x7f79ec0b4050 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec167cb0 con 0x7f79ec0b3c70 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec167fb0 con 0x7f79ec06d460 2024-09-10T11:52:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ec0b4050 0x7f79ec1640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ec0b4050 0x7f79ec1640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37850/0 (socket says 172.21.15.78:37850) 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 -- 172.21.15.78:0/4124466711 learned_addr learned my addr 172.21.15.78:0/4124466711 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79ea7fc640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec0b3c70 0x7f79ec163ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eaffd640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec06d460 0x7f79ec14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 -- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec06d460 msgr2=0x7f79ec14ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec06d460 0x7f79ec14ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 -- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec0b3c70 msgr2=0x7f79ec163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec0b3c70 0x7f79ec163ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 -- 172.21.15.78:0/4124466711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec14f460 con 0x7f79ec0b4050 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79eb7fe640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ec0b4050 0x7f79ec1640e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79e401b190 tx=0x7f79e4009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40bb070 con 0x7f79ec0b4050 2024-09-10T11:52:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79e4004d40 con 0x7f79ec0b4050 2024-09-10T11:52:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec1f7c10 con 0x7f79ec0b4050 2024-09-10T11:52:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b2040 con 0x7f79ec0b4050 2024-09-10T11:52:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec1f81d0 con 0x7f79ec0b4050 2024-09-10T11:52:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79ec070000 con 0x7f79ec0b4050 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.798+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f79e40a5b10 con 0x7f79ec0b4050 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79d3fff640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f79d806f710 0x7f79d8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f79e4129d20 con 0x7f79ec0b4050 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79d3fff640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7f79d8077910 0x7f79d8079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 --> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79e40afe90 con 0x7f79d8077910 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f79e412a150 con 0x7f79ec0b4050 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79eaffd640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f79d806f710 0x7f79d8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79ea7fc640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7f79d8077910 0x7f79d8079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79ea7fc640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7f79d8077910 0x7f79d8079d30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79eaffd640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f79d806f710 0x7f79d8071bd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0016f0 tx=0x7f79dc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.802+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== osd.6 v2:172.21.15.112:6802/2669198428 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79e40afe90 con 0x7f79d8077910 2024-09-10T11:52:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 --> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f79ec06aa30 con 0x7f79d8077910 2024-09-10T11:52:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79d3fff640 1 -- 172.21.15.78:0/4124466711 <== osd.6 v2:172.21.15.112:6802/2669198428 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f79ec06aa30 con 0x7f79d8077910 2024-09-10T11:52:44.819 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:44.819 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:44.819 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7f79d8077910 msgr2=0x7f79d8079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6802/2669198428,v1:172.21.15.112:6803/2669198428] conn(0x7f79d8077910 0x7f79d8079d30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f79d806f710 msgr2=0x7f79d8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f79d806f710 0x7f79d8071bd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0016f0 tx=0x7f79dc009040 comp rx=0 tx=0).stop 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ec0b4050 msgr2=0x7f79ec1640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 --2- 172.21.15.78:0/4124466711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ec0b4050 0x7f79ec1640e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79e401b190 tx=0x7f79e4009200 comp rx=0 tx=0).stop 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79eb7fe640 1 -- 172.21.15.78:0/4124466711 reap_dead start 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 shutdown_connections 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 >> 172.21.15.78:0/4124466711 conn(0x7f79ec0b18a0 msgr2=0x7f79ec164870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 shutdown_connections 2024-09-10T11:52:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.818+0000 7f79f18eb640 1 -- 172.21.15.78:0/4124466711 wait complete. 2024-09-10T11:52:44.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- 172.21.15.78:0/2836502009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7680cf220 msgr2=0x7fe7680cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- 172.21.15.78:0/2836502009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7680cf220 0x7fe7680cc150 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe7680719d0 tx=0x7fe75801c8c0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- 172.21.15.78:0/2836502009 shutdown_connections 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- 172.21.15.78:0/2836502009 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76815fa00 0x7fe7680ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- 172.21.15.78:0/2836502009 >> v2:172.21.15.112:3300/0 conn(0x7fe768073450 0x7fe76815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- 172.21.15.78:0/2836502009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7680cf220 0x7fe7680cc150 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- 172.21.15.78:0/2836502009 >> 172.21.15.78:0/2836502009 conn(0x7fe7680b1490 msgr2=0x7fe7680b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- 172.21.15.78:0/2836502009 shutdown_connections 2024-09-10T11:52:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- 172.21.15.78:0/2836502009 wait complete. 2024-09-10T11:52:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 Processor -- start 2024-09-10T11:52:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- start start 2024-09-10T11:52:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768073450 0x7fe7681474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cf220 0x7fe768152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 0x7fe76815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe76815c400 con 0x7fe76815fa00 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe76815c280 con 0x7fe768073450 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.942+0000 7fe76dc21640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe76815c580 con 0x7fe7680cf220 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 0x7fe76815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 0x7fe76815e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37870/0 (socket says 172.21.15.78:37870) 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 -- 172.21.15.78:0/4045155047 learned_addr learned my addr 172.21.15.78:0/4045155047 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe7677fe640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768073450 0x7fe7681474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 -- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cf220 msgr2=0x7fe768152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cf220 0x7fe768152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 -- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768073450 msgr2=0x7fe7681474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768073450 0x7fe7681474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 -- 172.21.15.78:0/4045155047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe768147a00 con 0x7fe76815fa00 2024-09-10T11:52:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe767fff640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 0x7fe76815e380 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe76000b970 tx=0x7fe76000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760019070 con 0x7fe76815fa00 2024-09-10T11:52:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe76000cc50 con 0x7fe76815fa00 2024-09-10T11:52:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600146a0 con 0x7fe76815fa00 2024-09-10T11:52:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76815d2e0 con 0x7fe76815fa00 2024-09-10T11:52:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76815db80 con 0x7fe76815fa00 2024-09-10T11:52:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76815cb50 con 0x7fe76815fa00 2024-09-10T11:52:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7fe76001c070 con 0x7fe76815fa00 2024-09-10T11:52:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe74ffff640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75406f710 0x7fe754071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe76008f940 con 0x7fe76815fa00 2024-09-10T11:52:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe7677fe640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75406f710 0x7fe754071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.946+0000 7fe7677fe640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75406f710 0x7fe754071bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe7580af000 tx=0x7fe75801b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:44.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:44.950+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7fe760023020 con 0x7fe76815fa00 2024-09-10T11:52:45.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.094+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe7680b22c0 con 0x7fe75406f710 2024-09-10T11:52:45.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.094+0000 7fe74ffff640 1 -- 172.21.15.78:0/4045155047 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7680b22c0 con 0x7fe75406f710 2024-09-10T11:52:45.096 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75406f710 msgr2=0x7fe754071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75406f710 0x7fe754071bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe7580af000 tx=0x7fe75801b100 comp rx=0 tx=0).stop 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 msgr2=0x7fe76815e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 0x7fe76815e380 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe76000b970 tx=0x7fe76000be30 comp rx=0 tx=0).stop 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 shutdown_connections 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7fe75406f710 0x7fe754071bd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76815fa00 0x7fe76815e380 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cf220 0x7fe768152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 --2- 172.21.15.78:0/4045155047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768073450 0x7fe7681474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 >> 172.21.15.78:0/4045155047 conn(0x7fe7680b1490 msgr2=0x7fe76814f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 shutdown_connections 2024-09-10T11:52:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.098+0000 7fe76dc21640 1 -- 172.21.15.78:0/4045155047 wait complete. 2024-09-10T11:52:45.114 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T11:52:45.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 -- 172.21.15.78:0/1973670001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d8071680 msgr2=0x7f32d806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 --2- 172.21.15.78:0/1973670001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d8071680 0x7f32d806c950 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009900 tx=0x7f32c801c850 comp rx=0 tx=0).stop 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 -- 172.21.15.78:0/1973670001 shutdown_connections 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 --2- 172.21.15.78:0/1973670001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d8071680 0x7f32d806c950 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 --2- 172.21.15.78:0/1973670001 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32d815b9e0 0x7f32d80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 -- 172.21.15.78:0/1973670001 >> 172.21.15.78:0/1973670001 conn(0x7f32d80d08d0 msgr2=0x7f32d80d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 -- 172.21.15.78:0/1973670001 shutdown_connections 2024-09-10T11:52:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 -- 172.21.15.78:0/1973670001 wait complete. 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 Processor -- start 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 -- start start 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.230+0000 7f32df730640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d806ce90 0x7f32d814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32d8071680 0x7f32d815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32d815b9e0 0x7f32d815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8168c90 con 0x7f32d806ce90 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8168b10 con 0x7f32d8071680 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f32d8168e10 con 0x7f32d815b9e0 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d806ce90 0x7f32d814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d806ce90 0x7f32d814d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37896/0 (socket says 172.21.15.78:37896) 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 -- 172.21.15.78:0/3603900018 learned_addr learned my addr 172.21.15.78:0/3603900018 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dcccb640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32d8071680 0x7f32d815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 -- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32d815b9e0 msgr2=0x7f32d815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32d815b9e0 0x7f32d815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 -- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32d8071680 msgr2=0x7f32d815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32d8071680 0x7f32d815d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 -- 172.21.15.78:0/3603900018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d814c1a0 con 0x7f32d806ce90 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dd4cc640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d806ce90 0x7f32d814d930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f32d000e7d0 tx=0x7f32d000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d000ccc0 con 0x7f32d806ce90 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32d0010430 con 0x7f32d806ce90 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d815dcc0 con 0x7f32d806ce90 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0010860 con 0x7f32d806ce90 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d81572b0 con 0x7f32d806ce90 2024-09-10T11:52:45.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32d8157970 con 0x7f32d806ce90 2024-09-10T11:52:45.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f32d0010a00 con 0x7f32d806ce90 2024-09-10T11:52:45.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f32bc06f710 0x7f32bc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f32d0090d20 con 0x7f32d806ce90 2024-09-10T11:52:45.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f32bc077910 0x7f32bc079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 --> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32d0007e50 con 0x7f32bc077910 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f32d0091150 con 0x7f32d806ce90 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32dcccb640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f32bc06f710 0x7f32bc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.234+0000 7f32ddccd640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f32bc077910 0x7f32bc079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.238+0000 7f32dcccb640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f32bc06f710 0x7f32bc071bd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32c80af000 tx=0x7f32c801b090 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.238+0000 7f32ddccd640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f32bc077910 0x7f32bc079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.238+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== osd.7 v2:172.21.15.112:6810/485234655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32d0007e50 con 0x7f32bc077910 2024-09-10T11:52:45.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 --> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f32d806c950 con 0x7f32bc077910 2024-09-10T11:52:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32cdffb640 1 -- 172.21.15.78:0/3603900018 <== osd.7 v2:172.21.15.112:6810/485234655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f32d806c950 con 0x7f32bc077910 2024-09-10T11:52:45.252 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-10T11:52:45.253 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:52:45.253 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f32bc077910 msgr2=0x7f32bc079d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6810/485234655,v1:172.21.15.112:6811/485234655] conn(0x7f32bc077910 0x7f32bc079d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f32bc06f710 msgr2=0x7f32bc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f32bc06f710 0x7f32bc071bd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32c80af000 tx=0x7f32c801b090 comp rx=0 tx=0).stop 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d806ce90 msgr2=0x7f32d814d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 --2- 172.21.15.78:0/3603900018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d806ce90 0x7f32d814d930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f32d000e7d0 tx=0x7f32d000ec90 comp rx=0 tx=0).stop 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32ddccd640 1 -- 172.21.15.78:0/3603900018 reap_dead start 2024-09-10T11:52:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 shutdown_connections 2024-09-10T11:52:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 >> 172.21.15.78:0/3603900018 conn(0x7f32d80d08d0 msgr2=0x7f32d81565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 shutdown_connections 2024-09-10T11:52:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.250+0000 7f32df730640 1 -- 172.21.15.78:0/3603900018 wait complete. 2024-09-10T11:52:45.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T11:52:45.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 -- 172.21.15.78:0/3566275914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e415fa00 msgr2=0x7f50e40ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 --2- 172.21.15.78:0/3566275914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e415fa00 0x7f50e40ae510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f50e406de50 tx=0x7f50dc01cd60 comp rx=0 tx=0).stop 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 -- 172.21.15.78:0/3566275914 shutdown_connections 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 --2- 172.21.15.78:0/3566275914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e415fa00 0x7f50e40ae510 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 --2- 172.21.15.78:0/3566275914 >> v2:172.21.15.112:3300/0 conn(0x7f50e4073450 0x7f50e415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 --2- 172.21.15.78:0/3566275914 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50e40cf220 0x7f50e40cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 -- 172.21.15.78:0/3566275914 >> 172.21.15.78:0/3566275914 conn(0x7f50e40b1490 msgr2=0x7f50e40b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 -- 172.21.15.78:0/3566275914 shutdown_connections 2024-09-10T11:52:45.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.370+0000 7f50eb398640 1 -- 172.21.15.78:0/3566275914 wait complete. 2024-09-10T11:52:45.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 Processor -- start 2024-09-10T11:52:45.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- start start 2024-09-10T11:52:45.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 0x7f50e414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e40cf220 0x7f50e41492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50e415fa00 0x7f50e414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f50e415c410 con 0x7f50e4073450 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50e415c290 con 0x7f50e40cf220 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f50e415c590 con 0x7f50e415fa00 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 0x7f50e414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 0x7f50e414b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37906/0 (socket says 172.21.15.78:37906) 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 -- 172.21.15.78:0/4224299511 learned_addr learned my addr 172.21.15.78:0/4224299511 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e8933640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e40cf220 0x7f50e41492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9935640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50e415fa00 0x7f50e414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 -- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50e415fa00 msgr2=0x7f50e414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50e415fa00 0x7f50e414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 -- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e40cf220 msgr2=0x7f50e41492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e40cf220 0x7f50e41492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 -- 172.21.15.78:0/4224299511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e414beb0 con 0x7f50e4073450 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50e9134640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 0x7f50e414b970 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50e000b550 tx=0x7f50e000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0014070 con 0x7f50e4073450 2024-09-10T11:52:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e0010980 con 0x7f50e4073450 2024-09-10T11:52:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0010dd0 con 0x7f50e4073450 2024-09-10T11:52:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e414dd60 con 0x7f50e4073450 2024-09-10T11:52:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e41533e0 con 0x7f50e4073450 2024-09-10T11:52:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.374+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e415cb80 con 0x7f50e4073450 2024-09-10T11:52:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.378+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f50e0017070 con 0x7f50e4073450 2024-09-10T11:52:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.378+0000 7f50d9ffb640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f50c806f710 0x7f50c8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.378+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f50e008f730 con 0x7f50e4073450 2024-09-10T11:52:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.378+0000 7f50e8933640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f50c806f710 0x7f50c8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.378+0000 7f50e8933640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f50c806f710 0x7f50c8071bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f50e415e7d0 tx=0x7f50d4008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.382+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f50e005c5c0 con 0x7f50e4073450 2024-09-10T11:52:45.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f50e41497e0 con 0x7f50c806f710 2024-09-10T11:52:45.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50d9ffb640 1 -- 172.21.15.78:0/4224299511 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50e41497e0 con 0x7f50c806f710 2024-09-10T11:52:45.518 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T11:52:45.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f50c806f710 msgr2=0x7f50c8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f50c806f710 0x7f50c8071bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f50e415e7d0 tx=0x7f50d4008040 comp rx=0 tx=0).stop 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 msgr2=0x7f50e414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 0x7f50e414b970 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50e000b550 tx=0x7f50e000ba10 comp rx=0 tx=0).stop 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 shutdown_connections 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e40cf220 0x7f50e41492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f50c806f710 0x7f50c8071bd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50e415fa00 0x7f50e414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 --2- 172.21.15.78:0/4224299511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e4073450 0x7f50e414b970 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 >> 172.21.15.78:0/4224299511 conn(0x7f50e40b1490 msgr2=0x7f50e415d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 shutdown_connections 2024-09-10T11:52:45.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.518+0000 7f50eb398640 1 -- 172.21.15.78:0/4224299511 wait complete. 2024-09-10T11:52:45.536 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:52:45.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/554414384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85380b4a10 msgr2=0x7f85380b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 --2- 172.21.15.78:0/554414384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85380b4a10 0x7f85380b33a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8528009840 tx=0x7f852801c7f0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/554414384 shutdown_connections 2024-09-10T11:52:45.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 --2- 172.21.15.78:0/554414384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85380b4a10 0x7f85380b33a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 --2- 172.21.15.78:0/554414384 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8538161250 0x7f85380d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/554414384 >> 172.21.15.78:0/554414384 conn(0x7f85380d3c80 msgr2=0x7f85380d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/554414384 shutdown_connections 2024-09-10T11:52:45.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/554414384 wait complete. 2024-09-10T11:52:45.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 Processor -- start 2024-09-10T11:52:45.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- start start 2024-09-10T11:52:45.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85380b4a10 0x7f85380cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 0x7f8538152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8538161630 0x7f85381fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f853816acc0 con 0x7f8538161250 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f853816ab40 con 0x7f85380b4a10 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f853816ae40 con 0x7f8538161630 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 0x7f8538152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 0x7f8538152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37916/0 (socket says 172.21.15.78:37916) 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 -- 172.21.15.78:0/2067261436 learned_addr learned my addr 172.21.15.78:0/2067261436 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853e980640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8538161630 0x7f85381fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853e17f640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85380b4a10 0x7f85380cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 -- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8538161630 msgr2=0x7f85381fb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8538161630 0x7f85381fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 -- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85380b4a10 msgr2=0x7f85380cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85380b4a10 0x7f85380cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 -- 172.21.15.78:0/2067261436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85380cbc70 con 0x7f8538161250 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f853d97e640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 0x7f8538152510 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f853400cb40 tx=0x7f853400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534016020 con 0x7f8538161250 2024-09-10T11:52:45.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853400ab40 con 0x7f8538161250 2024-09-10T11:52:45.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85380cbf50 con 0x7f8538161250 2024-09-10T11:52:45.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534012420 con 0x7f8538161250 2024-09-10T11:52:45.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85380cc510 con 0x7f8538161250 2024-09-10T11:52:45.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.658+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85380b33a0 con 0x7f8538161250 2024-09-10T11:52:45.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.662+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f8534019020 con 0x7f8538161250 2024-09-10T11:52:45.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.662+0000 7f852effd640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f852406f740 0x7f8524071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:52:45.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.662+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f853408fad0 con 0x7f8538161250 2024-09-10T11:52:45.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.662+0000 7f853e17f640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f852406f740 0x7f8524071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:52:45.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.662+0000 7f853e17f640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f852406f740 0x7f8524071c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f853000a830 tx=0x7f8530008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:52:45.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.666+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f8534020020 con 0x7f8538161250 2024-09-10T11:52:45.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.794+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85380b63a0 con 0x7f852406f740 2024-09-10T11:52:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.806+0000 7f852effd640 1 -- 172.21.15.78:0/2067261436 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251814 (secure 0 0 0) 0x7f85380b63a0 con 0x7f852406f740 2024-09-10T11:52:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:52:45.812 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f852406f740 msgr2=0x7f8524071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f852406f740 0x7f8524071c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f853000a830 tx=0x7f8530008040 comp rx=0 tx=0).stop 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 msgr2=0x7f8538152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 0x7f8538152510 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f853400cb40 tx=0x7f853400cc30 comp rx=0 tx=0).stop 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 shutdown_connections 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f852406f740 0x7f8524071c00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8538161630 0x7f85381fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538161250 0x7f8538152510 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 --2- 172.21.15.78:0/2067261436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85380b4a10 0x7f85380cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:52:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 >> 172.21.15.78:0/2067261436 conn(0x7f85380d3c80 msgr2=0x7f853815e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:52:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 shutdown_connections 2024-09-10T11:52:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:52:45.810+0000 7f85403e3640 1 -- 172.21.15.78:0/2067261436 wait complete. 2024-09-10T11:52:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-10T11:52:45.362506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223640,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751080,"statfs":{"total":773094113280,"available":772865105920,"internally_reserved":0,"allocated":3317760,"data_stored":1930740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005211"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434244+0000","last_change":"2024-09-10T11:47:27.770635+0000","last_active":"2024-09-10T11:49:36.434244+0000","last_peered":"2024-09-10T11:49:36.434244+0000","last_clean":"2024-09-10T11:49:36.434244+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:49:36.434244+0000","last_undegraded":"2024-09-10T11:49:36.434244+0000","last_fullsized":"2024-09-10T11:49:36.434244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:55.829542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428368+0000","last_change":"2024-09-10T11:47:27.772814+0000","last_active":"2024-09-10T11:49:36.428368+0000","last_peered":"2024-09-10T11:49:36.428368+0000","last_clean":"2024-09-10T11:49:36.428368+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:49:36.428368+0000","last_undegraded":"2024-09-10T11:49:36.428368+0000","last_fullsized":"2024-09-10T11:49:36.428368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428343+0000","last_change":"2024-09-10T11:47:27.749110+0000","last_active":"2024-09-10T11:49:36.428343+0000","last_peered":"2024-09-10T11:49:36.428343+0000","last_clean":"2024-09-10T11:49:36.428343+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:49:36.428343+0000","last_undegraded":"2024-09-10T11:49:36.428343+0000","last_fullsized":"2024-09-10T11:49:36.428343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:57.818425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.431756+0000","last_change":"2024-09-10T11:47:27.758098+0000","last_active":"2024-09-10T11:49:31.431756+0000","last_peered":"2024-09-10T11:49:31.431756+0000","last_clean":"2024-09-10T11:49:31.431756+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:49:31.431756+0000","last_undegraded":"2024-09-10T11:49:31.431756+0000","last_fullsized":"2024-09-10T11:49:31.431756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:48:11.416638+0000","last_change":"2024-09-10T11:48:08.362038+0000","last_active":"2024-09-10T11:48:11.416638+0000","last_peered":"2024-09-10T11:48:11.416638+0000","last_clean":"2024-09-10T11:48:11.416638+0000","last_became_active":"2024-09-10T11:48:08.361135+0000","last_became_peered":"2024-09-10T11:48:08.361135+0000","last_unstale":"2024-09-10T11:48:11.416638+0000","last_undegraded":"2024-09-10T11:48:11.416638+0000","last_fullsized":"2024-09-10T11:48:11.416638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:10.036485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437880+0000","last_change":"2024-09-10T11:47:27.747349+0000","last_active":"2024-09-10T11:50:01.437880+0000","last_peered":"2024-09-10T11:50:01.437880+0000","last_clean":"2024-09-10T11:50:01.437880+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:50:01.437880+0000","last_undegraded":"2024-09-10T11:50:01.437880+0000","last_fullsized":"2024-09-10T11:50:01.437880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438586+0000","last_change":"2024-09-10T11:47:27.771452+0000","last_active":"2024-09-10T11:50:01.438586+0000","last_peered":"2024-09-10T11:50:01.438586+0000","last_clean":"2024-09-10T11:50:01.438586+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:50:01.438586+0000","last_undegraded":"2024-09-10T11:50:01.438586+0000","last_fullsized":"2024-09-10T11:50:01.438586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:38.797275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.432667+0000","last_change":"2024-09-10T11:47:27.752976+0000","last_active":"2024-09-10T11:50:01.432667+0000","last_peered":"2024-09-10T11:50:01.432667+0000","last_clean":"2024-09-10T11:50:01.432667+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:50:01.432667+0000","last_undegraded":"2024-09-10T11:50:01.432667+0000","last_fullsized":"2024-09-10T11:50:01.432667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:27.903721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436877+0000","last_change":"2024-09-10T11:47:27.761911+0000","last_active":"2024-09-10T11:49:56.436877+0000","last_peered":"2024-09-10T11:49:56.436877+0000","last_clean":"2024-09-10T11:49:56.436877+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:49:56.436877+0000","last_undegraded":"2024-09-10T11:49:56.436877+0000","last_fullsized":"2024-09-10T11:49:56.436877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.418589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437733+0000","last_change":"2024-09-10T11:47:27.771845+0000","last_active":"2024-09-10T11:49:56.437733+0000","last_peered":"2024-09-10T11:49:56.437733+0000","last_clean":"2024-09-10T11:49:56.437733+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:49:56.437733+0000","last_undegraded":"2024-09-10T11:49:56.437733+0000","last_fullsized":"2024-09-10T11:49:56.437733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:26.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437633+0000","last_change":"2024-09-10T11:47:27.771787+0000","last_active":"2024-09-10T11:49:56.437633+0000","last_peered":"2024-09-10T11:49:56.437633+0000","last_clean":"2024-09-10T11:49:56.437633+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:49:56.437633+0000","last_undegraded":"2024-09-10T11:49:56.437633+0000","last_fullsized":"2024-09-10T11:49:56.437633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:20.792164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437534+0000","last_change":"2024-09-10T11:47:27.780175+0000","last_active":"2024-09-10T11:49:56.437534+0000","last_peered":"2024-09-10T11:49:56.437534+0000","last_clean":"2024-09-10T11:49:56.437534+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:49:56.437534+0000","last_undegraded":"2024-09-10T11:49:56.437534+0000","last_fullsized":"2024-09-10T11:49:56.437534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:04.325052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430214+0000","last_change":"2024-09-10T11:47:27.783359+0000","last_active":"2024-09-10T11:49:54.430214+0000","last_peered":"2024-09-10T11:49:54.430214+0000","last_clean":"2024-09-10T11:49:54.430214+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:49:54.430214+0000","last_undegraded":"2024-09-10T11:49:54.430214+0000","last_fullsized":"2024-09-10T11:49:54.430214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:16.737158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429349+0000","last_change":"2024-09-10T11:47:27.783881+0000","last_active":"2024-09-10T11:49:49.429349+0000","last_peered":"2024-09-10T11:49:49.429349+0000","last_clean":"2024-09-10T11:49:49.429349+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:49:49.429349+0000","last_undegraded":"2024-09-10T11:49:49.429349+0000","last_fullsized":"2024-09-10T11:49:49.429349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:43.696712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.430994+0000","last_change":"2024-09-10T11:47:27.756814+0000","last_active":"2024-09-10T11:49:51.430994+0000","last_peered":"2024-09-10T11:49:51.430994+0000","last_clean":"2024-09-10T11:49:51.430994+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:49:51.430994+0000","last_undegraded":"2024-09-10T11:49:51.430994+0000","last_fullsized":"2024-09-10T11:49:51.430994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438862+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:49:51.438862+0000","last_peered":"2024-09-10T11:49:51.438862+0000","last_clean":"2024-09-10T11:49:51.438862+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:49:51.438862+0000","last_undegraded":"2024-09-10T11:49:51.438862+0000","last_fullsized":"2024-09-10T11:49:51.438862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.439047+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:49:51.439047+0000","last_peered":"2024-09-10T11:49:51.439047+0000","last_clean":"2024-09-10T11:49:51.439047+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:49:51.439047+0000","last_undegraded":"2024-09-10T11:49:51.439047+0000","last_fullsized":"2024-09-10T11:49:51.439047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431703+0000","last_change":"2024-09-10T11:47:27.771992+0000","last_active":"2024-09-10T11:49:51.431703+0000","last_peered":"2024-09-10T11:49:51.431703+0000","last_clean":"2024-09-10T11:49:51.431703+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:49:51.431703+0000","last_undegraded":"2024-09-10T11:49:51.431703+0000","last_fullsized":"2024-09-10T11:49:51.431703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438202+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:49:46.438202+0000","last_peered":"2024-09-10T11:49:46.438202+0000","last_clean":"2024-09-10T11:49:46.438202+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:49:46.438202+0000","last_undegraded":"2024-09-10T11:49:46.438202+0000","last_fullsized":"2024-09-10T11:49:46.438202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435797+0000","last_change":"2024-09-10T11:47:27.778714+0000","last_active":"2024-09-10T11:49:46.435797+0000","last_peered":"2024-09-10T11:49:46.435797+0000","last_clean":"2024-09-10T11:49:46.435797+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:49:46.435797+0000","last_undegraded":"2024-09-10T11:49:46.435797+0000","last_fullsized":"2024-09-10T11:49:46.435797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436559+0000","last_change":"2024-09-10T11:47:27.749876+0000","last_active":"2024-09-10T11:49:46.436559+0000","last_peered":"2024-09-10T11:49:46.436559+0000","last_clean":"2024-09-10T11:49:46.436559+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:49:46.436559+0000","last_undegraded":"2024-09-10T11:49:46.436559+0000","last_fullsized":"2024-09-10T11:49:46.436559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:34.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434727+0000","last_change":"2024-09-10T11:47:27.759955+0000","last_active":"2024-09-10T11:49:46.434727+0000","last_peered":"2024-09-10T11:49:46.434727+0000","last_clean":"2024-09-10T11:49:46.434727+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:49:46.434727+0000","last_undegraded":"2024-09-10T11:49:46.434727+0000","last_fullsized":"2024-09-10T11:49:46.434727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430017+0000","last_change":"2024-09-10T11:47:27.748311+0000","last_active":"2024-09-10T11:49:46.430017+0000","last_peered":"2024-09-10T11:49:46.430017+0000","last_clean":"2024-09-10T11:49:46.430017+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:49:46.430017+0000","last_undegraded":"2024-09-10T11:49:46.430017+0000","last_fullsized":"2024-09-10T11:49:46.430017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437160+0000","last_change":"2024-09-10T11:47:27.761338+0000","last_active":"2024-09-10T11:49:41.437160+0000","last_peered":"2024-09-10T11:49:41.437160+0000","last_clean":"2024-09-10T11:49:41.437160+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:49:41.437160+0000","last_undegraded":"2024-09-10T11:49:41.437160+0000","last_fullsized":"2024-09-10T11:49:41.437160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.622350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429267+0000","last_change":"2024-09-10T11:47:27.761489+0000","last_active":"2024-09-10T11:49:41.429267+0000","last_peered":"2024-09-10T11:49:41.429267+0000","last_clean":"2024-09-10T11:49:41.429267+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:49:41.429267+0000","last_undegraded":"2024-09-10T11:49:41.429267+0000","last_fullsized":"2024-09-10T11:49:41.429267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:10.095177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.433795+0000","last_change":"2024-09-10T11:47:27.756365+0000","last_active":"2024-09-10T11:49:41.433795+0000","last_peered":"2024-09-10T11:49:41.433795+0000","last_clean":"2024-09-10T11:49:41.433795+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:49:41.433795+0000","last_undegraded":"2024-09-10T11:49:41.433795+0000","last_fullsized":"2024-09-10T11:49:41.433795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:56.075008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427797+0000","last_change":"2024-09-10T11:47:27.770887+0000","last_active":"2024-09-10T11:49:39.427797+0000","last_peered":"2024-09-10T11:49:39.427797+0000","last_clean":"2024-09-10T11:49:39.427797+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:49:39.427797+0000","last_undegraded":"2024-09-10T11:49:39.427797+0000","last_fullsized":"2024-09-10T11:49:39.427797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:39.074052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427772+0000","last_change":"2024-09-10T11:47:27.766904+0000","last_active":"2024-09-10T11:49:39.427772+0000","last_peered":"2024-09-10T11:49:39.427772+0000","last_clean":"2024-09-10T11:49:39.427772+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:49:39.427772+0000","last_undegraded":"2024-09-10T11:49:39.427772+0000","last_fullsized":"2024-09-10T11:49:39.427772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:36.570944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428301+0000","last_change":"2024-09-10T11:47:27.760817+0000","last_active":"2024-09-10T11:49:36.428301+0000","last_peered":"2024-09-10T11:49:36.428301+0000","last_clean":"2024-09-10T11:49:36.428301+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:49:36.428301+0000","last_undegraded":"2024-09-10T11:49:36.428301+0000","last_fullsized":"2024-09-10T11:49:36.428301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436262+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:49:36.436262+0000","last_peered":"2024-09-10T11:49:36.436262+0000","last_clean":"2024-09-10T11:49:36.436262+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:49:36.436262+0000","last_undegraded":"2024-09-10T11:49:36.436262+0000","last_fullsized":"2024-09-10T11:49:36.436262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.429212+0000","last_change":"2024-09-10T11:47:27.767803+0000","last_active":"2024-09-10T11:49:36.429212+0000","last_peered":"2024-09-10T11:49:36.429212+0000","last_clean":"2024-09-10T11:49:36.429212+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:49:36.429212+0000","last_undegraded":"2024-09-10T11:49:36.429212+0000","last_fullsized":"2024-09-10T11:49:36.429212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432744+0000","last_change":"2024-09-10T11:47:27.781750+0000","last_active":"2024-09-10T11:49:36.432744+0000","last_peered":"2024-09-10T11:49:36.432744+0000","last_clean":"2024-09-10T11:49:36.432744+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:49:36.432744+0000","last_undegraded":"2024-09-10T11:49:36.432744+0000","last_fullsized":"2024-09-10T11:49:36.432744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:39.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437881+0000","last_change":"2024-09-10T11:47:27.760328+0000","last_active":"2024-09-10T11:50:01.437881+0000","last_peered":"2024-09-10T11:50:01.437881+0000","last_clean":"2024-09-10T11:50:01.437881+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:50:01.437881+0000","last_undegraded":"2024-09-10T11:50:01.437881+0000","last_fullsized":"2024-09-10T11:50:01.437881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431860+0000","last_change":"2024-09-10T11:47:26.761846+0000","last_active":"2024-09-10T11:49:56.431860+0000","last_peered":"2024-09-10T11:49:56.431860+0000","last_clean":"2024-09-10T11:49:56.431860+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:49:56.431860+0000","last_undegraded":"2024-09-10T11:49:56.431860+0000","last_fullsized":"2024-09-10T11:49:56.431860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.438909+0000","last_change":"2024-09-10T11:47:27.789211+0000","last_active":"2024-09-10T11:50:01.438909+0000","last_peered":"2024-09-10T11:50:01.438909+0000","last_clean":"2024-09-10T11:50:01.438909+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:50:01.438909+0000","last_undegraded":"2024-09-10T11:50:01.438909+0000","last_fullsized":"2024-09-10T11:50:01.438909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:24.081807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.439795+0000","last_change":"2024-09-10T11:47:26.749991+0000","last_active":"2024-09-10T11:49:56.439795+0000","last_peered":"2024-09-10T11:49:56.439795+0000","last_clean":"2024-09-10T11:49:56.439795+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:49:56.439795+0000","last_undegraded":"2024-09-10T11:49:56.439795+0000","last_fullsized":"2024-09-10T11:49:56.439795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:54.430158+0000","last_change":"2024-09-10T11:47:26.751212+0000","last_active":"2024-09-10T11:49:54.430158+0000","last_peered":"2024-09-10T11:49:54.430158+0000","last_clean":"2024-09-10T11:49:54.430158+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:49:54.430158+0000","last_undegraded":"2024-09-10T11:49:54.430158+0000","last_fullsized":"2024-09-10T11:49:54.430158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:17.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431811+0000","last_change":"2024-09-10T11:47:27.772773+0000","last_active":"2024-09-10T11:49:56.431811+0000","last_peered":"2024-09-10T11:49:56.431811+0000","last_clean":"2024-09-10T11:49:56.431811+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:49:56.431811+0000","last_undegraded":"2024-09-10T11:49:56.431811+0000","last_fullsized":"2024-09-10T11:49:56.431811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:11.089326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438899+0000","last_change":"2024-09-10T11:47:26.741954+0000","last_active":"2024-09-10T11:49:51.438899+0000","last_peered":"2024-09-10T11:49:51.438899+0000","last_clean":"2024-09-10T11:49:51.438899+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:49:51.438899+0000","last_undegraded":"2024-09-10T11:49:51.438899+0000","last_fullsized":"2024-09-10T11:49:51.438899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:16.711583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.438050+0000","last_change":"2024-09-10T11:47:27.752395+0000","last_active":"2024-09-10T11:49:56.438050+0000","last_peered":"2024-09-10T11:49:56.438050+0000","last_clean":"2024-09-10T11:49:56.438050+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:49:56.438050+0000","last_undegraded":"2024-09-10T11:49:56.438050+0000","last_fullsized":"2024-09-10T11:49:56.438050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:11.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435922+0000","last_change":"2024-09-10T11:47:26.757283+0000","last_active":"2024-09-10T11:49:51.435922+0000","last_peered":"2024-09-10T11:49:51.435922+0000","last_clean":"2024-09-10T11:49:51.435922+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:49:51.435922+0000","last_undegraded":"2024-09-10T11:49:51.435922+0000","last_fullsized":"2024-09-10T11:49:51.435922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.436869+0000","last_change":"2024-09-10T11:47:27.765424+0000","last_active":"2024-09-10T11:49:56.436869+0000","last_peered":"2024-09-10T11:49:56.436869+0000","last_clean":"2024-09-10T11:49:56.436869+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:49:56.436869+0000","last_undegraded":"2024-09-10T11:49:56.436869+0000","last_fullsized":"2024-09-10T11:49:56.436869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:49.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.436613+0000","last_change":"2024-09-10T11:47:26.745932+0000","last_active":"2024-09-10T11:49:51.436613+0000","last_peered":"2024-09-10T11:49:51.436613+0000","last_clean":"2024-09-10T11:49:51.436613+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:49:51.436613+0000","last_undegraded":"2024-09-10T11:49:51.436613+0000","last_fullsized":"2024-09-10T11:49:51.436613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:19.192116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.431909+0000","last_change":"2024-09-10T11:47:27.747953+0000","last_active":"2024-09-10T11:49:56.431909+0000","last_peered":"2024-09-10T11:49:56.431909+0000","last_clean":"2024-09-10T11:49:56.431909+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:49:56.431909+0000","last_undegraded":"2024-09-10T11:49:56.431909+0000","last_fullsized":"2024-09-10T11:49:56.431909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:50.267524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.431666+0000","last_change":"2024-09-10T11:47:26.759536+0000","last_active":"2024-09-10T11:49:51.431666+0000","last_peered":"2024-09-10T11:49:51.431666+0000","last_clean":"2024-09-10T11:49:51.431666+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:49:51.431666+0000","last_undegraded":"2024-09-10T11:49:51.431666+0000","last_fullsized":"2024-09-10T11:49:51.431666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:09.476843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438994+0000","last_change":"2024-09-10T11:47:27.769402+0000","last_active":"2024-09-10T11:49:51.438994+0000","last_peered":"2024-09-10T11:49:51.438994+0000","last_clean":"2024-09-10T11:49:51.438994+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:49:51.438994+0000","last_undegraded":"2024-09-10T11:49:51.438994+0000","last_fullsized":"2024-09-10T11:49:51.438994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:00.252644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434743+0000","last_change":"2024-09-10T11:47:26.759480+0000","last_active":"2024-09-10T11:49:46.434743+0000","last_peered":"2024-09-10T11:49:46.434743+0000","last_clean":"2024-09-10T11:49:46.434743+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:49:46.434743+0000","last_undegraded":"2024-09-10T11:49:46.434743+0000","last_fullsized":"2024-09-10T11:49:46.434743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:11.531277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437662+0000","last_change":"2024-09-10T11:47:27.775563+0000","last_active":"2024-09-10T11:49:56.437662+0000","last_peered":"2024-09-10T11:49:56.437662+0000","last_clean":"2024-09-10T11:49:56.437662+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:49:56.437662+0000","last_undegraded":"2024-09-10T11:49:56.437662+0000","last_fullsized":"2024-09-10T11:49:56.437662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:27.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430815+0000","last_change":"2024-09-10T11:47:26.752557+0000","last_active":"2024-09-10T11:49:46.430815+0000","last_peered":"2024-09-10T11:49:46.430815+0000","last_clean":"2024-09-10T11:49:46.430815+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:49:46.430815+0000","last_undegraded":"2024-09-10T11:49:46.430815+0000","last_fullsized":"2024-09-10T11:49:46.430815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:49.429393+0000","last_change":"2024-09-10T11:47:27.768542+0000","last_active":"2024-09-10T11:49:49.429393+0000","last_peered":"2024-09-10T11:49:49.429393+0000","last_clean":"2024-09-10T11:49:49.429393+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:49:49.429393+0000","last_undegraded":"2024-09-10T11:49:49.429393+0000","last_fullsized":"2024-09-10T11:49:49.429393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:52.140007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438128+0000","last_change":"2024-09-10T11:47:26.751227+0000","last_active":"2024-09-10T11:49:46.438128+0000","last_peered":"2024-09-10T11:49:46.438128+0000","last_clean":"2024-09-10T11:49:46.438128+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:49:46.438128+0000","last_undegraded":"2024-09-10T11:49:46.438128+0000","last_fullsized":"2024-09-10T11:49:46.438128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:23.541158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438966+0000","last_change":"2024-09-10T11:47:27.777026+0000","last_active":"2024-09-10T11:49:51.438966+0000","last_peered":"2024-09-10T11:49:51.438966+0000","last_clean":"2024-09-10T11:49:51.438966+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:49:51.438966+0000","last_undegraded":"2024-09-10T11:49:51.438966+0000","last_fullsized":"2024-09-10T11:49:51.438966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.712769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435759+0000","last_change":"2024-09-10T11:47:26.751397+0000","last_active":"2024-09-10T11:49:46.435759+0000","last_peered":"2024-09-10T11:49:46.435759+0000","last_clean":"2024-09-10T11:49:46.435759+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:49:46.435759+0000","last_undegraded":"2024-09-10T11:49:46.435759+0000","last_fullsized":"2024-09-10T11:49:46.435759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.094710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.435809+0000","last_change":"2024-09-10T11:47:27.759024+0000","last_active":"2024-09-10T11:49:51.435809+0000","last_peered":"2024-09-10T11:49:51.435809+0000","last_clean":"2024-09-10T11:49:51.435809+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:49:51.435809+0000","last_undegraded":"2024-09-10T11:49:51.435809+0000","last_fullsized":"2024-09-10T11:49:51.435809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:24.552306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.436510+0000","last_change":"2024-09-10T11:47:26.760165+0000","last_active":"2024-09-10T11:49:46.436510+0000","last_peered":"2024-09-10T11:49:46.436510+0000","last_clean":"2024-09-10T11:49:46.436510+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:49:46.436510+0000","last_undegraded":"2024-09-10T11:49:46.436510+0000","last_fullsized":"2024-09-10T11:49:46.436510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438925+0000","last_change":"2024-09-10T11:47:27.766408+0000","last_active":"2024-09-10T11:49:51.438925+0000","last_peered":"2024-09-10T11:49:51.438925+0000","last_clean":"2024-09-10T11:49:51.438925+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:49:51.438925+0000","last_undegraded":"2024-09-10T11:49:51.438925+0000","last_fullsized":"2024-09-10T11:49:51.438925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:51.165553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435056+0000","last_change":"2024-09-10T11:47:26.767513+0000","last_active":"2024-09-10T11:49:41.435056+0000","last_peered":"2024-09-10T11:49:41.435056+0000","last_clean":"2024-09-10T11:49:41.435056+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:49:41.435056+0000","last_undegraded":"2024-09-10T11:49:41.435056+0000","last_fullsized":"2024-09-10T11:49:41.435056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:56.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.434831+0000","last_change":"2024-09-10T11:47:27.765266+0000","last_active":"2024-09-10T11:49:46.434831+0000","last_peered":"2024-09-10T11:49:46.434831+0000","last_clean":"2024-09-10T11:49:46.434831+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:49:46.434831+0000","last_undegraded":"2024-09-10T11:49:46.434831+0000","last_fullsized":"2024-09-10T11:49:46.434831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:17.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435747+0000","last_change":"2024-09-10T11:47:26.769502+0000","last_active":"2024-09-10T11:49:41.435747+0000","last_peered":"2024-09-10T11:49:41.435747+0000","last_clean":"2024-09-10T11:49:41.435747+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:49:41.435747+0000","last_undegraded":"2024-09-10T11:49:41.435747+0000","last_fullsized":"2024-09-10T11:49:41.435747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:48.793184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435859+0000","last_change":"2024-09-10T11:47:27.775830+0000","last_active":"2024-09-10T11:49:46.435859+0000","last_peered":"2024-09-10T11:49:46.435859+0000","last_clean":"2024-09-10T11:49:46.435859+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:49:46.435859+0000","last_undegraded":"2024-09-10T11:49:46.435859+0000","last_fullsized":"2024-09-10T11:49:46.435859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:25.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.429216+0000","last_change":"2024-09-10T11:47:26.750109+0000","last_active":"2024-09-10T11:49:41.429216+0000","last_peered":"2024-09-10T11:49:41.429216+0000","last_clean":"2024-09-10T11:49:41.429216+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:49:41.429216+0000","last_undegraded":"2024-09-10T11:49:41.429216+0000","last_fullsized":"2024-09-10T11:49:41.429216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:22.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.435817+0000","last_change":"2024-09-10T11:47:27.778393+0000","last_active":"2024-09-10T11:49:46.435817+0000","last_peered":"2024-09-10T11:49:46.435817+0000","last_clean":"2024-09-10T11:49:46.435817+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:49:46.435817+0000","last_undegraded":"2024-09-10T11:49:46.435817+0000","last_fullsized":"2024-09-10T11:49:46.435817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:55.851055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:44.428573+0000","last_change":"2024-09-10T11:47:26.755432+0000","last_active":"2024-09-10T11:49:44.428573+0000","last_peered":"2024-09-10T11:49:44.428573+0000","last_clean":"2024-09-10T11:49:44.428573+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:49:44.428573+0000","last_undegraded":"2024-09-10T11:49:44.428573+0000","last_fullsized":"2024-09-10T11:49:44.428573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:57.156850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438182+0000","last_change":"2024-09-10T11:47:27.766867+0000","last_active":"2024-09-10T11:49:46.438182+0000","last_peered":"2024-09-10T11:49:46.438182+0000","last_clean":"2024-09-10T11:49:46.438182+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:49:46.438182+0000","last_undegraded":"2024-09-10T11:49:46.438182+0000","last_fullsized":"2024-09-10T11:49:46.438182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:55.553282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:21.429807+0000","last_change":"2024-09-10T11:47:19.226313+0000","last_active":"2024-09-10T11:49:21.429807+0000","last_peered":"2024-09-10T11:49:21.429807+0000","last_clean":"2024-09-10T11:49:21.429807+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:49:21.429807+0000","last_undegraded":"2024-09-10T11:49:21.429807+0000","last_fullsized":"2024-09-10T11:49:21.429807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:18.201117+0000","last_clean_scrub_stamp":"2024-09-10T11:47:18.201117+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:46.426423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435419+0000","last_change":"2024-09-10T11:47:26.737477+0000","last_active":"2024-09-10T11:49:31.435419+0000","last_peered":"2024-09-10T11:49:31.435419+0000","last_clean":"2024-09-10T11:49:31.435419+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:49:31.435419+0000","last_undegraded":"2024-09-10T11:49:31.435419+0000","last_fullsized":"2024-09-10T11:49:31.435419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:26.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434760+0000","last_change":"2024-09-10T11:47:27.749680+0000","last_active":"2024-09-10T11:49:36.434760+0000","last_peered":"2024-09-10T11:49:36.434760+0000","last_clean":"2024-09-10T11:49:36.434760+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:49:36.434760+0000","last_undegraded":"2024-09-10T11:49:36.434760+0000","last_fullsized":"2024-09-10T11:49:36.434760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:51.045474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.434506+0000","last_change":"2024-09-10T11:47:26.767358+0000","last_active":"2024-09-10T11:49:26.434506+0000","last_peered":"2024-09-10T11:49:26.434506+0000","last_clean":"2024-09-10T11:49:26.434506+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:49:26.434506+0000","last_undegraded":"2024-09-10T11:49:26.434506+0000","last_fullsized":"2024-09-10T11:49:26.434506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:18.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426883+0000","last_change":"2024-09-10T11:47:27.771092+0000","last_active":"2024-09-10T11:49:34.426883+0000","last_peered":"2024-09-10T11:49:34.426883+0000","last_clean":"2024-09-10T11:49:34.426883+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:49:34.426883+0000","last_undegraded":"2024-09-10T11:49:34.426883+0000","last_fullsized":"2024-09-10T11:49:34.426883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:51.047272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.428445+0000","last_change":"2024-09-10T11:47:26.764680+0000","last_active":"2024-09-10T11:49:31.428445+0000","last_peered":"2024-09-10T11:49:31.428445+0000","last_clean":"2024-09-10T11:49:31.428445+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:49:31.428445+0000","last_undegraded":"2024-09-10T11:49:31.428445+0000","last_fullsized":"2024-09-10T11:49:31.428445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427438+0000","last_change":"2024-09-10T11:47:27.760781+0000","last_active":"2024-09-10T11:49:31.427438+0000","last_peered":"2024-09-10T11:49:31.427438+0000","last_clean":"2024-09-10T11:49:31.427438+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:49:31.427438+0000","last_undegraded":"2024-09-10T11:49:31.427438+0000","last_fullsized":"2024-09-10T11:49:31.427438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.349353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435377+0000","last_change":"2024-09-10T11:47:26.744289+0000","last_active":"2024-09-10T11:49:31.435377+0000","last_peered":"2024-09-10T11:49:31.435377+0000","last_clean":"2024-09-10T11:49:31.435377+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:49:31.435377+0000","last_undegraded":"2024-09-10T11:49:31.435377+0000","last_fullsized":"2024-09-10T11:49:31.435377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:55.063860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434189+0000","last_change":"2024-09-10T11:47:27.774362+0000","last_active":"2024-09-10T11:49:36.434189+0000","last_peered":"2024-09-10T11:49:36.434189+0000","last_clean":"2024-09-10T11:49:36.434189+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:49:36.434189+0000","last_undegraded":"2024-09-10T11:49:36.434189+0000","last_fullsized":"2024-09-10T11:49:36.434189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:32.868506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427490+0000","last_change":"2024-09-10T11:47:26.760449+0000","last_active":"2024-09-10T11:49:31.427490+0000","last_peered":"2024-09-10T11:49:31.427490+0000","last_clean":"2024-09-10T11:49:31.427490+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:49:31.427490+0000","last_undegraded":"2024-09-10T11:49:31.427490+0000","last_fullsized":"2024-09-10T11:49:31.427490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:52.126847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.432822+0000","last_change":"2024-09-10T11:47:27.759385+0000","last_active":"2024-09-10T11:49:36.432822+0000","last_peered":"2024-09-10T11:49:36.432822+0000","last_clean":"2024-09-10T11:49:36.432822+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:49:36.432822+0000","last_undegraded":"2024-09-10T11:49:36.432822+0000","last_fullsized":"2024-09-10T11:49:36.432822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:49.793833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.435448+0000","last_change":"2024-09-10T11:47:26.749322+0000","last_active":"2024-09-10T11:49:31.435448+0000","last_peered":"2024-09-10T11:49:31.435448+0000","last_clean":"2024-09-10T11:49:31.435448+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:49:31.435448+0000","last_undegraded":"2024-09-10T11:49:31.435448+0000","last_fullsized":"2024-09-10T11:49:31.435448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.247218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:34.426945+0000","last_change":"2024-09-10T11:47:27.784567+0000","last_active":"2024-09-10T11:49:34.426945+0000","last_peered":"2024-09-10T11:49:34.426945+0000","last_clean":"2024-09-10T11:49:34.426945+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:49:34.426945+0000","last_undegraded":"2024-09-10T11:49:34.426945+0000","last_fullsized":"2024-09-10T11:49:34.426945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:36.812346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434806+0000","last_change":"2024-09-10T11:47:26.761184+0000","last_active":"2024-09-10T11:49:36.434806+0000","last_peered":"2024-09-10T11:49:36.434806+0000","last_clean":"2024-09-10T11:49:36.434806+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:49:36.434806+0000","last_undegraded":"2024-09-10T11:49:36.434806+0000","last_fullsized":"2024-09-10T11:49:36.434806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.385192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435792+0000","last_change":"2024-09-10T11:47:27.785733+0000","last_active":"2024-09-10T11:49:41.435792+0000","last_peered":"2024-09-10T11:49:41.435792+0000","last_clean":"2024-09-10T11:49:41.435792+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:49:41.435792+0000","last_undegraded":"2024-09-10T11:49:41.435792+0000","last_fullsized":"2024-09-10T11:49:41.435792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:20.662905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436374+0000","last_change":"2024-09-10T11:47:26.750916+0000","last_active":"2024-09-10T11:49:36.436374+0000","last_peered":"2024-09-10T11:49:36.436374+0000","last_clean":"2024-09-10T11:49:36.436374+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:49:36.436374+0000","last_undegraded":"2024-09-10T11:49:36.436374+0000","last_fullsized":"2024-09-10T11:49:36.436374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:33.548075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435715+0000","last_change":"2024-09-10T11:47:27.768231+0000","last_active":"2024-09-10T11:49:41.435715+0000","last_peered":"2024-09-10T11:49:41.435715+0000","last_clean":"2024-09-10T11:49:41.435715+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:49:41.435715+0000","last_undegraded":"2024-09-10T11:49:41.435715+0000","last_fullsized":"2024-09-10T11:49:41.435715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:28.326908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434146+0000","last_change":"2024-09-10T11:47:26.748979+0000","last_active":"2024-09-10T11:49:36.434146+0000","last_peered":"2024-09-10T11:49:36.434146+0000","last_clean":"2024-09-10T11:49:36.434146+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:49:36.434146+0000","last_undegraded":"2024-09-10T11:49:36.434146+0000","last_fullsized":"2024-09-10T11:49:36.434146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437230+0000","last_change":"2024-09-10T11:47:27.763588+0000","last_active":"2024-09-10T11:49:41.437230+0000","last_peered":"2024-09-10T11:49:41.437230+0000","last_clean":"2024-09-10T11:49:41.437230+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:49:41.437230+0000","last_undegraded":"2024-09-10T11:49:41.437230+0000","last_fullsized":"2024-09-10T11:49:41.437230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.434724+0000","last_change":"2024-09-10T11:47:26.762480+0000","last_active":"2024-09-10T11:49:36.434724+0000","last_peered":"2024-09-10T11:49:36.434724+0000","last_clean":"2024-09-10T11:49:36.434724+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:49:36.434724+0000","last_undegraded":"2024-09-10T11:49:36.434724+0000","last_fullsized":"2024-09-10T11:49:36.434724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:42.360617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.435652+0000","last_change":"2024-09-10T11:47:27.748766+0000","last_active":"2024-09-10T11:49:41.435652+0000","last_peered":"2024-09-10T11:49:41.435652+0000","last_clean":"2024-09-10T11:49:41.435652+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:49:41.435652+0000","last_undegraded":"2024-09-10T11:49:41.435652+0000","last_fullsized":"2024-09-10T11:49:41.435652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:26.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:39.427732+0000","last_change":"2024-09-10T11:47:26.769211+0000","last_active":"2024-09-10T11:49:39.427732+0000","last_peered":"2024-09-10T11:49:39.427732+0000","last_clean":"2024-09-10T11:49:39.427732+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:49:39.427732+0000","last_undegraded":"2024-09-10T11:49:39.427732+0000","last_fullsized":"2024-09-10T11:49:39.427732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:11.022890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.430777+0000","last_change":"2024-09-10T11:47:27.787156+0000","last_active":"2024-09-10T11:49:46.430777+0000","last_peered":"2024-09-10T11:49:46.430777+0000","last_clean":"2024-09-10T11:49:46.430777+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:49:46.430777+0000","last_undegraded":"2024-09-10T11:49:46.430777+0000","last_fullsized":"2024-09-10T11:49:46.430777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437325+0000","last_change":"2024-09-10T11:47:26.738950+0000","last_active":"2024-09-10T11:49:41.437325+0000","last_peered":"2024-09-10T11:49:41.437325+0000","last_clean":"2024-09-10T11:49:41.437325+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:49:41.437325+0000","last_undegraded":"2024-09-10T11:49:41.437325+0000","last_fullsized":"2024-09-10T11:49:41.437325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:48.472052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:41.437268+0000","last_change":"2024-09-10T11:47:27.766617+0000","last_active":"2024-09-10T11:49:41.437268+0000","last_peered":"2024-09-10T11:49:41.437268+0000","last_clean":"2024-09-10T11:49:41.437268+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:49:41.437268+0000","last_undegraded":"2024-09-10T11:49:41.437268+0000","last_fullsized":"2024-09-10T11:49:41.437268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:39.156136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.440585+0000","last_change":"2024-09-10T11:47:27.759886+0000","last_active":"2024-09-10T11:50:01.440585+0000","last_peered":"2024-09-10T11:50:01.440585+0000","last_clean":"2024-09-10T11:50:01.440585+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:50:01.440585+0000","last_undegraded":"2024-09-10T11:50:01.440585+0000","last_fullsized":"2024-09-10T11:50:01.440585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.483875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437593+0000","last_change":"2024-09-10T11:47:26.745901+0000","last_active":"2024-09-10T11:49:56.437593+0000","last_peered":"2024-09-10T11:49:56.437593+0000","last_clean":"2024-09-10T11:49:56.437593+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:49:56.437593+0000","last_undegraded":"2024-09-10T11:49:56.437593+0000","last_fullsized":"2024-09-10T11:49:56.437593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:42.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:50:01.437936+0000","last_change":"2024-09-10T11:47:27.760090+0000","last_active":"2024-09-10T11:50:01.437936+0000","last_peered":"2024-09-10T11:50:01.437936+0000","last_clean":"2024-09-10T11:50:01.437936+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:50:01.437936+0000","last_undegraded":"2024-09-10T11:50:01.437936+0000","last_fullsized":"2024-09-10T11:50:01.437936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:36.412729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:56.437692+0000","last_change":"2024-09-10T11:47:26.749317+0000","last_active":"2024-09-10T11:49:56.437692+0000","last_peered":"2024-09-10T11:49:56.437692+0000","last_clean":"2024-09-10T11:49:56.437692+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:49:56.437692+0000","last_undegraded":"2024-09-10T11:49:56.437692+0000","last_fullsized":"2024-09-10T11:49:56.437692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:53.438697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.428397+0000","last_change":"2024-09-10T11:47:27.766798+0000","last_active":"2024-09-10T11:49:36.428397+0000","last_peered":"2024-09-10T11:49:36.428397+0000","last_clean":"2024-09-10T11:49:36.428397+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:49:36.428397+0000","last_undegraded":"2024-09-10T11:49:36.428397+0000","last_fullsized":"2024-09-10T11:49:36.428397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.142358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:26.426657+0000","last_change":"2024-09-10T11:47:26.752896+0000","last_active":"2024-09-10T11:49:26.426657+0000","last_peered":"2024-09-10T11:49:26.426657+0000","last_clean":"2024-09-10T11:49:26.426657+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:49:26.426657+0000","last_undegraded":"2024-09-10T11:49:26.426657+0000","last_fullsized":"2024-09-10T11:49:26.426657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:26.255530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.427539+0000","last_change":"2024-09-10T11:47:27.768573+0000","last_active":"2024-09-10T11:49:31.427539+0000","last_peered":"2024-09-10T11:49:31.427539+0000","last_clean":"2024-09-10T11:49:31.427539+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:49:31.427539+0000","last_undegraded":"2024-09-10T11:49:31.427539+0000","last_fullsized":"2024-09-10T11:49:31.427539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:56.281027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:31.433884+0000","last_change":"2024-09-10T11:47:26.761879+0000","last_active":"2024-09-10T11:49:31.433884+0000","last_peered":"2024-09-10T11:49:31.433884+0000","last_clean":"2024-09-10T11:49:31.433884+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:49:31.433884+0000","last_undegraded":"2024-09-10T11:49:31.433884+0000","last_fullsized":"2024-09-10T11:49:31.433884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:25.698723+0000","last_clean_scrub_stamp":"2024-09-10T11:47:25.698723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:38.978322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":93272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":683608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":95432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":94760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":93148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:52:45.835 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.835 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.835 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.835 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.835 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.836 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.837 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.838 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.839 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.840 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.841 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T11:47:18.201117+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.842 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.843 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.844 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.845 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.846 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.846 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.846 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-10T11:47:25.698723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:52:45.846 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T11:52:51.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:52:51.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:05.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:53:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- 172.21.15.78:0/2467288176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 msgr2=0x7f56980cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 --2- 172.21.15.78:0/2467288176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f56980cde60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f56980b4c90 tx=0x7f569001cd80 comp rx=0 tx=0).stop 2024-09-10T11:53:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- 172.21.15.78:0/2467288176 shutdown_connections 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 --2- 172.21.15.78:0/2467288176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f56980cde60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 --2- 172.21.15.78:0/2467288176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 0x7f569815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- 172.21.15.78:0/2467288176 >> 172.21.15.78:0/2467288176 conn(0x7f56980cf7c0 msgr2=0x7f56980cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- 172.21.15.78:0/2467288176 shutdown_connections 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- 172.21.15.78:0/2467288176 wait complete. 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 Processor -- start 2024-09-10T11:53:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- start start 2024-09-10T11:53:05.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f569815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:05.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 0x7f569815e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:05.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f569815f8a0 0x7f569813a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5698168880 con 0x7f569806e810 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5698168700 con 0x7f569815f8a0 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569cd77640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5698168a00 con 0x7f56980cc090 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f569815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f569815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51920/0 (socket says 172.21.15.78:51920) 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 -- 172.21.15.78:0/3523685484 learned_addr learned my addr 172.21.15.78:0/3523685484 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f5696d9d640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f569815f8a0 0x7f569813a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f5695d9b640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 0x7f569815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 -- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 msgr2=0x7f569815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 0x7f569815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 -- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f569815f8a0 msgr2=0x7f569813a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f569815f8a0 0x7f569813a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 -- 172.21.15.78:0/3523685484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5698150b40 con 0x7f569806e810 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f5695d9b640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 0x7f569815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f569659c640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f569815b700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f568000d9b0 tx=0x7f568000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680017070 con 0x7f569806e810 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5680009cc0 con 0x7f569806e810 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.982+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680005280 con 0x7f569806e810 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569813aea0 con 0x7f569806e810 2024-09-10T11:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569813da40 con 0x7f569806e810 2024-09-10T11:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569814f3f0 con 0x7f569806e810 2024-09-10T11:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f5680005420 con 0x7f569806e810 2024-09-10T11:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f568effd640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f567806f710 0x7f5678071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f568008fb50 con 0x7f569806e810 2024-09-10T11:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f5695d9b640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f567806f710 0x7f5678071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.986+0000 7f5695d9b640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f567806f710 0x7f5678071bd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56980b2480 tx=0x7f5688008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:05.990+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f569813aea0 con 0x7f569806e810 2024-09-10T11:53:06.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.126+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56980cde60 con 0x7f567806f710 2024-09-10T11:53:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.138+0000 7f568effd640 1 -- 172.21.15.78:0/3523685484 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251874 (secure 0 0 0) 0x7f56980cde60 con 0x7f567806f710 2024-09-10T11:53:06.141 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:53:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f567806f710 msgr2=0x7f5678071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f567806f710 0x7f5678071bd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56980b2480 tx=0x7f5688008040 comp rx=0 tx=0).stop 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 msgr2=0x7f569815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f569815b700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f568000d9b0 tx=0x7f568000de70 comp rx=0 tx=0).stop 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 shutdown_connections 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f569815f8a0 0x7f569813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f567806f710 0x7f5678071bd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56980cc090 0x7f569815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 --2- 172.21.15.78:0/3523685484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569806e810 0x7f569815b700 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 >> 172.21.15.78:0/3523685484 conn(0x7f56980cf7c0 msgr2=0x7f5698165c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:53:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 shutdown_connections 2024-09-10T11:53:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:06.142+0000 7f569cd77640 1 -- 172.21.15.78:0/3523685484 wait complete. 2024-09-10T11:53:06.157 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-10T11:53:05.370000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223592,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751128,"statfs":{"total":773094113280,"available":772865155072,"internally_reserved":0,"allocated":3317760,"data_stored":1930740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004675"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:57.257115+0000","last_change":"2024-09-10T11:52:57.257115+0000","last_active":"2024-09-10T11:52:57.257115+0000","last_peered":"2024-09-10T11:52:57.257115+0000","last_clean":"2024-09-10T11:52:57.257115+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:52:57.257115+0000","last_undegraded":"2024-09-10T11:52:57.257115+0000","last_fullsized":"2024-09-10T11:52:57.257115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:57.256940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:57.256940+0000","last_clean_scrub_stamp":"2024-09-10T11:52:57.256940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:20.056153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:00.715889+0000","last_change":"2024-09-10T11:53:00.715889+0000","last_active":"2024-09-10T11:53:00.715889+0000","last_peered":"2024-09-10T11:53:00.715889+0000","last_clean":"2024-09-10T11:53:00.715889+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:53:00.715889+0000","last_undegraded":"2024-09-10T11:53:00.715889+0000","last_fullsized":"2024-09-10T11:53:00.715889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:00.715664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:00.715664+0000","last_clean_scrub_stamp":"2024-09-10T11:53:00.715664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:11.355277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:59.695516+0000","last_change":"2024-09-10T11:52:59.695516+0000","last_active":"2024-09-10T11:52:59.695516+0000","last_peered":"2024-09-10T11:52:59.695516+0000","last_clean":"2024-09-10T11:52:59.695516+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:52:59.695516+0000","last_undegraded":"2024-09-10T11:52:59.695516+0000","last_fullsized":"2024-09-10T11:52:59.695516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:59.695322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:59.695322+0000","last_clean_scrub_stamp":"2024-09-10T11:52:59.695322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:54.913889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.091579+0000","last_change":"2024-09-10T11:52:49.091579+0000","last_active":"2024-09-10T11:52:49.091579+0000","last_peered":"2024-09-10T11:52:49.091579+0000","last_clean":"2024-09-10T11:52:49.091579+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:52:49.091579+0000","last_undegraded":"2024-09-10T11:52:49.091579+0000","last_fullsized":"2024-09-10T11:52:49.091579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.091358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.091358+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.091358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:14.787593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.196978+0000","last_change":"2024-09-10T11:52:52.196978+0000","last_active":"2024-09-10T11:52:52.196978+0000","last_peered":"2024-09-10T11:52:52.196978+0000","last_clean":"2024-09-10T11:52:52.196978+0000","last_became_active":"2024-09-10T11:48:08.361135+0000","last_became_peered":"2024-09-10T11:48:08.361135+0000","last_unstale":"2024-09-10T11:52:52.196978+0000","last_undegraded":"2024-09-10T11:52:52.196978+0000","last_fullsized":"2024-09-10T11:52:52.196978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.196692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.196692+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.196692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.751195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.075877+0000","last_change":"2024-09-10T11:52:47.075877+0000","last_active":"2024-09-10T11:52:47.075877+0000","last_peered":"2024-09-10T11:52:47.075877+0000","last_clean":"2024-09-10T11:52:47.075877+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:52:47.075877+0000","last_undegraded":"2024-09-10T11:52:47.075877+0000","last_fullsized":"2024-09-10T11:52:47.075877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.075665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.075665+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.075665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:12.515528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.304959+0000","last_change":"2024-09-10T11:52:56.304959+0000","last_active":"2024-09-10T11:52:56.304959+0000","last_peered":"2024-09-10T11:52:56.304959+0000","last_clean":"2024-09-10T11:52:56.304959+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:52:56.304959+0000","last_undegraded":"2024-09-10T11:52:56.304959+0000","last_fullsized":"2024-09-10T11:52:56.304959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.304774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.304774+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.304774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:37.357256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:58.670269+0000","last_change":"2024-09-10T11:52:58.670269+0000","last_active":"2024-09-10T11:52:58.670269+0000","last_peered":"2024-09-10T11:52:58.670269+0000","last_clean":"2024-09-10T11:52:58.670269+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:52:58.670269+0000","last_undegraded":"2024-09-10T11:52:58.670269+0000","last_fullsized":"2024-09-10T11:52:58.670269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:58.670089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:58.670089+0000","last_clean_scrub_stamp":"2024-09-10T11:52:58.670089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:22.375489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.092894+0000","last_change":"2024-09-10T11:52:46.092894+0000","last_active":"2024-09-10T11:52:46.092894+0000","last_peered":"2024-09-10T11:52:46.092894+0000","last_clean":"2024-09-10T11:52:46.092894+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:52:46.092894+0000","last_undegraded":"2024-09-10T11:52:46.092894+0000","last_fullsized":"2024-09-10T11:52:46.092894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.092723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.092723+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.092723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.086184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.316751+0000","last_change":"2024-09-10T11:52:54.316751+0000","last_active":"2024-09-10T11:52:54.316751+0000","last_peered":"2024-09-10T11:52:54.316751+0000","last_clean":"2024-09-10T11:52:54.316751+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:52:54.316751+0000","last_undegraded":"2024-09-10T11:52:54.316751+0000","last_fullsized":"2024-09-10T11:52:54.316751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.316526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.316526+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.316526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:07.019501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.281200+0000","last_change":"2024-09-10T11:52:55.281200+0000","last_active":"2024-09-10T11:52:55.281200+0000","last_peered":"2024-09-10T11:52:55.281200+0000","last_clean":"2024-09-10T11:52:55.281200+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:52:55.281200+0000","last_undegraded":"2024-09-10T11:52:55.281200+0000","last_fullsized":"2024-09-10T11:52:55.281200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.281022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.281022+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.281022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:46.904174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:58.294434+0000","last_change":"2024-09-10T11:52:58.294434+0000","last_active":"2024-09-10T11:52:58.294434+0000","last_peered":"2024-09-10T11:52:58.294434+0000","last_clean":"2024-09-10T11:52:58.294434+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:52:58.294434+0000","last_undegraded":"2024-09-10T11:52:58.294434+0000","last_fullsized":"2024-09-10T11:52:58.294434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:58.294231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:58.294231+0000","last_clean_scrub_stamp":"2024-09-10T11:52:58.294231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:49.213009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.879146+0000","last_change":"2024-09-10T11:52:54.879146+0000","last_active":"2024-09-10T11:52:54.879146+0000","last_peered":"2024-09-10T11:52:54.879146+0000","last_clean":"2024-09-10T11:52:54.879146+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:52:54.879146+0000","last_undegraded":"2024-09-10T11:52:54.879146+0000","last_fullsized":"2024-09-10T11:52:54.879146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.878958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.878958+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.878958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:04.026651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.827867+0000","last_change":"2024-09-10T11:52:52.827867+0000","last_active":"2024-09-10T11:52:52.827867+0000","last_peered":"2024-09-10T11:52:52.827867+0000","last_clean":"2024-09-10T11:52:52.827867+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:52:52.827867+0000","last_undegraded":"2024-09-10T11:52:52.827867+0000","last_fullsized":"2024-09-10T11:52:52.827867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.827629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.827629+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.827629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:53.083225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:57.641930+0000","last_change":"2024-09-10T11:52:57.641930+0000","last_active":"2024-09-10T11:52:57.641930+0000","last_peered":"2024-09-10T11:52:57.641930+0000","last_clean":"2024-09-10T11:52:57.641930+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:52:57.641930+0000","last_undegraded":"2024-09-10T11:52:57.641930+0000","last_fullsized":"2024-09-10T11:52:57.641930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:57.641749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:57.641749+0000","last_clean_scrub_stamp":"2024-09-10T11:52:57.641749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:53.265424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.438862+0000","last_change":"2024-09-10T11:47:27.768744+0000","last_active":"2024-09-10T11:49:51.438862+0000","last_peered":"2024-09-10T11:49:51.438862+0000","last_clean":"2024-09-10T11:49:51.438862+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:49:51.438862+0000","last_undegraded":"2024-09-10T11:49:51.438862+0000","last_fullsized":"2024-09-10T11:49:51.438862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:18.125817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:51.439047+0000","last_change":"2024-09-10T11:47:27.760879+0000","last_active":"2024-09-10T11:49:51.439047+0000","last_peered":"2024-09-10T11:49:51.439047+0000","last_clean":"2024-09-10T11:49:51.439047+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:49:51.439047+0000","last_undegraded":"2024-09-10T11:49:51.439047+0000","last_fullsized":"2024-09-10T11:49:51.439047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:21.885675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.242757+0000","last_change":"2024-09-10T11:52:49.242757+0000","last_active":"2024-09-10T11:52:49.242757+0000","last_peered":"2024-09-10T11:52:49.242757+0000","last_clean":"2024-09-10T11:52:49.242757+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:52:49.242757+0000","last_undegraded":"2024-09-10T11:52:49.242757+0000","last_fullsized":"2024-09-10T11:52:49.242757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.242581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.242581+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.242581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:42.672415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:46.438202+0000","last_change":"2024-09-10T11:47:27.750716+0000","last_active":"2024-09-10T11:49:46.438202+0000","last_peered":"2024-09-10T11:49:46.438202+0000","last_clean":"2024-09-10T11:49:46.438202+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:49:46.438202+0000","last_undegraded":"2024-09-10T11:49:46.438202+0000","last_fullsized":"2024-09-10T11:49:46.438202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:40.663534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.303302+0000","last_change":"2024-09-10T11:52:53.303302+0000","last_active":"2024-09-10T11:52:53.303302+0000","last_peered":"2024-09-10T11:52:53.303302+0000","last_clean":"2024-09-10T11:52:53.303302+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:52:53.303302+0000","last_undegraded":"2024-09-10T11:52:53.303302+0000","last_fullsized":"2024-09-10T11:52:53.303302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.303094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.303094+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.303094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:15.652494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.247238+0000","last_change":"2024-09-10T11:52:56.247238+0000","last_active":"2024-09-10T11:52:56.247238+0000","last_peered":"2024-09-10T11:52:56.247238+0000","last_clean":"2024-09-10T11:52:56.247238+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:52:56.247238+0000","last_undegraded":"2024-09-10T11:52:56.247238+0000","last_fullsized":"2024-09-10T11:52:56.247238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.247021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.247021+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.247021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:55.151933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.148022+0000","last_change":"2024-09-10T11:52:49.148022+0000","last_active":"2024-09-10T11:52:49.148022+0000","last_peered":"2024-09-10T11:52:49.148022+0000","last_clean":"2024-09-10T11:52:49.148022+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:52:49.148022+0000","last_undegraded":"2024-09-10T11:52:49.148022+0000","last_fullsized":"2024-09-10T11:52:49.148022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.147763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.147763+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.147763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:38.877769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.691120+0000","last_change":"2024-09-10T11:52:56.691120+0000","last_active":"2024-09-10T11:52:56.691120+0000","last_peered":"2024-09-10T11:52:56.691120+0000","last_clean":"2024-09-10T11:52:56.691120+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:52:56.691120+0000","last_undegraded":"2024-09-10T11:52:56.691120+0000","last_fullsized":"2024-09-10T11:52:56.691120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.690923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.690923+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.690923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:54:36.705101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:00.763960+0000","last_change":"2024-09-10T11:53:00.763960+0000","last_active":"2024-09-10T11:53:00.763960+0000","last_peered":"2024-09-10T11:53:00.763960+0000","last_clean":"2024-09-10T11:53:00.763960+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:53:00.763960+0000","last_undegraded":"2024-09-10T11:53:00.763960+0000","last_fullsized":"2024-09-10T11:53:00.763960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:00.763778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:00.763778+0000","last_clean_scrub_stamp":"2024-09-10T11:53:00.763778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:40.384509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.681326+0000","last_change":"2024-09-10T11:52:54.681326+0000","last_active":"2024-09-10T11:52:54.681326+0000","last_peered":"2024-09-10T11:52:54.681326+0000","last_clean":"2024-09-10T11:52:54.681326+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:52:54.681326+0000","last_undegraded":"2024-09-10T11:52:54.681326+0000","last_fullsized":"2024-09-10T11:52:54.681326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.681122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.681122+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.681122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:43.329717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.092073+0000","last_change":"2024-09-10T11:52:48.092073+0000","last_active":"2024-09-10T11:52:48.092073+0000","last_peered":"2024-09-10T11:52:48.092073+0000","last_clean":"2024-09-10T11:52:48.092073+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:52:48.092073+0000","last_undegraded":"2024-09-10T11:52:48.092073+0000","last_fullsized":"2024-09-10T11:52:48.092073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.091892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.091892+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.091892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:01.791684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.858722+0000","last_change":"2024-09-10T11:52:53.858722+0000","last_active":"2024-09-10T11:52:53.858722+0000","last_peered":"2024-09-10T11:52:53.858722+0000","last_clean":"2024-09-10T11:52:53.858722+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:52:53.858722+0000","last_undegraded":"2024-09-10T11:52:53.858722+0000","last_fullsized":"2024-09-10T11:52:53.858722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.858519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.858519+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.858519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:30.352780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.835414+0000","last_change":"2024-09-10T11:52:51.835414+0000","last_active":"2024-09-10T11:52:51.835414+0000","last_peered":"2024-09-10T11:52:51.835414+0000","last_clean":"2024-09-10T11:52:51.835414+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:52:51.835414+0000","last_undegraded":"2024-09-10T11:52:51.835414+0000","last_fullsized":"2024-09-10T11:52:51.835414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.835241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.835241+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.835241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:50.195447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.633659+0000","last_change":"2024-09-10T11:52:53.633659+0000","last_active":"2024-09-10T11:52:53.633659+0000","last_peered":"2024-09-10T11:52:53.633659+0000","last_clean":"2024-09-10T11:52:53.633659+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:52:53.633659+0000","last_undegraded":"2024-09-10T11:52:53.633659+0000","last_fullsized":"2024-09-10T11:52:53.633659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.633442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.633442+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.633442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:26.709663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:49:36.436262+0000","last_change":"2024-09-10T11:47:27.761575+0000","last_active":"2024-09-10T11:49:36.436262+0000","last_peered":"2024-09-10T11:49:36.436262+0000","last_clean":"2024-09-10T11:49:36.436262+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:49:36.436262+0000","last_undegraded":"2024-09-10T11:49:36.436262+0000","last_fullsized":"2024-09-10T11:49:36.436262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:47:26.709871+0000","last_clean_scrub_stamp":"2024-09-10T11:47:26.709871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:36.891399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.197131+0000","last_change":"2024-09-10T11:52:50.197131+0000","last_active":"2024-09-10T11:52:50.197131+0000","last_peered":"2024-09-10T11:52:50.197131+0000","last_clean":"2024-09-10T11:52:50.197131+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:52:50.197131+0000","last_undegraded":"2024-09-10T11:52:50.197131+0000","last_fullsized":"2024-09-10T11:52:50.197131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.196834+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.196834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:46.264332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.083746+0000","last_change":"2024-09-10T11:52:50.083746+0000","last_active":"2024-09-10T11:52:50.083746+0000","last_peered":"2024-09-10T11:52:50.083746+0000","last_clean":"2024-09-10T11:52:50.083746+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:52:50.083746+0000","last_undegraded":"2024-09-10T11:52:50.083746+0000","last_fullsized":"2024-09-10T11:52:50.083746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.083553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.083553+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.083553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:32.636850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.122336+0000","last_change":"2024-09-10T11:52:47.122336+0000","last_active":"2024-09-10T11:52:47.122336+0000","last_peered":"2024-09-10T11:52:47.122336+0000","last_clean":"2024-09-10T11:52:47.122336+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:52:47.122336+0000","last_undegraded":"2024-09-10T11:52:47.122336+0000","last_fullsized":"2024-09-10T11:52:47.122336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.122154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.122154+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.122154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:12.562016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.666336+0000","last_change":"2024-09-10T11:52:45.666336+0000","last_active":"2024-09-10T11:52:45.666336+0000","last_peered":"2024-09-10T11:52:45.666336+0000","last_clean":"2024-09-10T11:52:45.666336+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:52:45.666336+0000","last_undegraded":"2024-09-10T11:52:45.666336+0000","last_fullsized":"2024-09-10T11:52:45.666336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-09-10T11:52:45.666123+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-09-10T11:52:45.666123+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.666123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:41.665619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.222318+0000","last_change":"2024-09-10T11:52:55.222318+0000","last_active":"2024-09-10T11:52:55.222318+0000","last_peered":"2024-09-10T11:52:55.222318+0000","last_clean":"2024-09-10T11:52:55.222318+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:52:55.222318+0000","last_undegraded":"2024-09-10T11:52:55.222318+0000","last_fullsized":"2024-09-10T11:52:55.222318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.222121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.222121+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.222121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:22.802787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.655967+0000","last_change":"2024-09-10T11:52:54.655967+0000","last_active":"2024-09-10T11:52:54.655967+0000","last_peered":"2024-09-10T11:52:54.655967+0000","last_clean":"2024-09-10T11:52:54.655967+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:52:54.655967+0000","last_undegraded":"2024-09-10T11:52:54.655967+0000","last_fullsized":"2024-09-10T11:52:54.655967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-09-10T11:52:54.655739+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-09-10T11:52:54.655739+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.655739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:49.860376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.942793+0000","last_change":"2024-09-10T11:52:46.942793+0000","last_active":"2024-09-10T11:52:46.942793+0000","last_peered":"2024-09-10T11:52:46.942793+0000","last_clean":"2024-09-10T11:52:46.942793+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:52:46.942793+0000","last_undegraded":"2024-09-10T11:52:46.942793+0000","last_fullsized":"2024-09-10T11:52:46.942793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.942617+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.942617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:10.603892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.632661+0000","last_change":"2024-09-10T11:52:51.632661+0000","last_active":"2024-09-10T11:52:51.632661+0000","last_peered":"2024-09-10T11:52:51.632661+0000","last_clean":"2024-09-10T11:52:51.632661+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:52:51.632661+0000","last_undegraded":"2024-09-10T11:52:51.632661+0000","last_fullsized":"2024-09-10T11:52:51.632661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.632434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.632434+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.632434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:22.570377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.602341+0000","last_change":"2024-09-10T11:52:50.602341+0000","last_active":"2024-09-10T11:52:50.602341+0000","last_peered":"2024-09-10T11:52:50.602341+0000","last_clean":"2024-09-10T11:52:50.602341+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:52:50.602341+0000","last_undegraded":"2024-09-10T11:52:50.602341+0000","last_fullsized":"2024-09-10T11:52:50.602341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.602163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.602163+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.602163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:46.225838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.173470+0000","last_change":"2024-09-10T11:52:53.173470+0000","last_active":"2024-09-10T11:52:53.173470+0000","last_peered":"2024-09-10T11:52:53.173470+0000","last_clean":"2024-09-10T11:52:53.173470+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:52:53.173470+0000","last_undegraded":"2024-09-10T11:52:53.173470+0000","last_fullsized":"2024-09-10T11:52:53.173470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.173257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.173257+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.173257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:17.644845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.105378+0000","last_change":"2024-09-10T11:52:44.105378+0000","last_active":"2024-09-10T11:52:44.105378+0000","last_peered":"2024-09-10T11:52:44.105378+0000","last_clean":"2024-09-10T11:52:44.105378+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:52:44.105378+0000","last_undegraded":"2024-09-10T11:52:44.105378+0000","last_fullsized":"2024-09-10T11:52:44.105378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.105304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.105304+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.105304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:05.230320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.038443+0000","last_change":"2024-09-10T11:52:51.038443+0000","last_active":"2024-09-10T11:52:51.038443+0000","last_peered":"2024-09-10T11:52:51.038443+0000","last_clean":"2024-09-10T11:52:51.038443+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:52:51.038443+0000","last_undegraded":"2024-09-10T11:52:51.038443+0000","last_fullsized":"2024-09-10T11:52:51.038443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.038254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.038254+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.038254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:36.821445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.290233+0000","last_change":"2024-09-10T11:52:49.290233+0000","last_active":"2024-09-10T11:52:49.290233+0000","last_peered":"2024-09-10T11:52:49.290233+0000","last_clean":"2024-09-10T11:52:49.290233+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:52:49.290233+0000","last_undegraded":"2024-09-10T11:52:49.290233+0000","last_fullsized":"2024-09-10T11:52:49.290233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.290063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.290063+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.290063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:22.366284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.637926+0000","last_change":"2024-09-10T11:52:49.637926+0000","last_active":"2024-09-10T11:52:49.637926+0000","last_peered":"2024-09-10T11:52:49.637926+0000","last_clean":"2024-09-10T11:52:49.637926+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:52:49.637926+0000","last_undegraded":"2024-09-10T11:52:49.637926+0000","last_fullsized":"2024-09-10T11:52:49.637926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.637740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.637740+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.637740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:03.563714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.179422+0000","last_change":"2024-09-10T11:52:47.179422+0000","last_active":"2024-09-10T11:52:47.179422+0000","last_peered":"2024-09-10T11:52:47.179422+0000","last_clean":"2024-09-10T11:52:47.179422+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:52:47.179422+0000","last_undegraded":"2024-09-10T11:52:47.179422+0000","last_fullsized":"2024-09-10T11:52:47.179422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-09-10T11:52:47.179205+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-09-10T11:52:47.179205+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.179205+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:46.601865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:58.726626+0000","last_change":"2024-09-10T11:52:58.726626+0000","last_active":"2024-09-10T11:52:58.726626+0000","last_peered":"2024-09-10T11:52:58.726626+0000","last_clean":"2024-09-10T11:52:58.726626+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:52:58.726626+0000","last_undegraded":"2024-09-10T11:52:58.726626+0000","last_fullsized":"2024-09-10T11:52:58.726626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:58.726453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:58.726453+0000","last_clean_scrub_stamp":"2024-09-10T11:52:58.726453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:47.608479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.074662+0000","last_change":"2024-09-10T11:52:46.074662+0000","last_active":"2024-09-10T11:52:46.074662+0000","last_peered":"2024-09-10T11:52:46.074662+0000","last_clean":"2024-09-10T11:52:46.074662+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:52:46.074662+0000","last_undegraded":"2024-09-10T11:52:46.074662+0000","last_fullsized":"2024-09-10T11:52:46.074662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-09-10T11:52:46.074476+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-09-10T11:52:46.074476+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.074476+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:42.141975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.340776+0000","last_change":"2024-09-10T11:52:52.340776+0000","last_active":"2024-09-10T11:52:52.340776+0000","last_peered":"2024-09-10T11:52:52.340776+0000","last_clean":"2024-09-10T11:52:52.340776+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:52:52.340776+0000","last_undegraded":"2024-09-10T11:52:52.340776+0000","last_fullsized":"2024-09-10T11:52:52.340776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.340585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.340585+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.340585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:13.089800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.130047+0000","last_change":"2024-09-10T11:52:46.130047+0000","last_active":"2024-09-10T11:52:46.130047+0000","last_peered":"2024-09-10T11:52:46.130047+0000","last_clean":"2024-09-10T11:52:46.130047+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:52:46.130047+0000","last_undegraded":"2024-09-10T11:52:46.130047+0000","last_fullsized":"2024-09-10T11:52:46.130047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-09-10T11:52:46.129879+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-09-10T11:52:46.129879+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.129879+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:48.903739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.917623+0000","last_change":"2024-09-10T11:52:49.917623+0000","last_active":"2024-09-10T11:52:49.917623+0000","last_peered":"2024-09-10T11:52:49.917623+0000","last_clean":"2024-09-10T11:52:49.917623+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:52:49.917623+0000","last_undegraded":"2024-09-10T11:52:49.917623+0000","last_fullsized":"2024-09-10T11:52:49.917623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.917431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.917431+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.917431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:04.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.562182+0000","last_change":"2024-09-10T11:52:51.562182+0000","last_active":"2024-09-10T11:52:51.562182+0000","last_peered":"2024-09-10T11:52:51.562182+0000","last_clean":"2024-09-10T11:52:51.562182+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:52:51.562182+0000","last_undegraded":"2024-09-10T11:52:51.562182+0000","last_fullsized":"2024-09-10T11:52:51.562182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.561990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.561990+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.561990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:43.185142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:57.676610+0000","last_change":"2024-09-10T11:52:57.676610+0000","last_active":"2024-09-10T11:52:57.676610+0000","last_peered":"2024-09-10T11:52:57.676610+0000","last_clean":"2024-09-10T11:52:57.676610+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:52:57.676610+0000","last_undegraded":"2024-09-10T11:52:57.676610+0000","last_fullsized":"2024-09-10T11:52:57.676610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:57.676432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:57.676432+0000","last_clean_scrub_stamp":"2024-09-10T11:52:57.676432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.482236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.262931+0000","last_change":"2024-09-10T11:52:44.262931+0000","last_active":"2024-09-10T11:52:44.262931+0000","last_peered":"2024-09-10T11:52:44.262931+0000","last_clean":"2024-09-10T11:52:44.262931+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:52:44.262931+0000","last_undegraded":"2024-09-10T11:52:44.262931+0000","last_fullsized":"2024-09-10T11:52:44.262931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.262838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.262838+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.262838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.167749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.102689+0000","last_change":"2024-09-10T11:52:45.102689+0000","last_active":"2024-09-10T11:52:45.102689+0000","last_peered":"2024-09-10T11:52:45.102689+0000","last_clean":"2024-09-10T11:52:45.102689+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:52:45.102689+0000","last_undegraded":"2024-09-10T11:52:45.102689+0000","last_fullsized":"2024-09-10T11:52:45.102689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.102572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.102572+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.102572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:15.259759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'12","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.081926+0000","last_change":"2024-09-10T11:52:48.081926+0000","last_active":"2024-09-10T11:52:48.081926+0000","last_peered":"2024-09-10T11:52:48.081926+0000","last_clean":"2024-09-10T11:52:48.081926+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:52:48.081926+0000","last_undegraded":"2024-09-10T11:52:48.081926+0000","last_fullsized":"2024-09-10T11:52:48.081926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'12","last_scrub_stamp":"2024-09-10T11:52:48.081688+0000","last_deep_scrub":"25'12","last_deep_scrub_stamp":"2024-09-10T11:52:48.081688+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.081688+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:14:45.264719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.677668+0000","last_change":"2024-09-10T11:52:55.677668+0000","last_active":"2024-09-10T11:52:55.677668+0000","last_peered":"2024-09-10T11:52:55.677668+0000","last_clean":"2024-09-10T11:52:55.677668+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:52:55.677668+0000","last_undegraded":"2024-09-10T11:52:55.677668+0000","last_fullsized":"2024-09-10T11:52:55.677668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.677395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.677395+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.677395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:04.445725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.268326+0000","last_change":"2024-09-10T11:52:45.268326+0000","last_active":"2024-09-10T11:52:45.268326+0000","last_peered":"2024-09-10T11:52:45.268326+0000","last_clean":"2024-09-10T11:52:45.268326+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:52:45.268326+0000","last_undegraded":"2024-09-10T11:52:45.268326+0000","last_fullsized":"2024-09-10T11:52:45.268326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-10T11:52:45.268216+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-10T11:52:45.268216+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.268216+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:59.194190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.087926+0000","last_change":"2024-09-10T11:52:45.087926+0000","last_active":"2024-09-10T11:52:45.087926+0000","last_peered":"2024-09-10T11:52:45.087926+0000","last_clean":"2024-09-10T11:52:45.087926+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:52:45.087926+0000","last_undegraded":"2024-09-10T11:52:45.087926+0000","last_fullsized":"2024-09-10T11:52:45.087926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.087742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.087742+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.087742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:38.517577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.119569+0000","last_change":"2024-09-10T11:52:46.119569+0000","last_active":"2024-09-10T11:52:46.119569+0000","last_peered":"2024-09-10T11:52:46.119569+0000","last_clean":"2024-09-10T11:52:46.119569+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:52:46.119569+0000","last_undegraded":"2024-09-10T11:52:46.119569+0000","last_fullsized":"2024-09-10T11:52:46.119569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:46.119346+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:46.119346+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.119346+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:25.019746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.333648+0000","last_change":"2024-09-10T11:52:50.333648+0000","last_active":"2024-09-10T11:52:50.333648+0000","last_peered":"2024-09-10T11:52:50.333648+0000","last_clean":"2024-09-10T11:52:50.333648+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:52:50.333648+0000","last_undegraded":"2024-09-10T11:52:50.333648+0000","last_fullsized":"2024-09-10T11:52:50.333648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.333469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.333469+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.333469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:32.863697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'2","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.593670+0000","last_change":"2024-09-10T11:52:50.593670+0000","last_active":"2024-09-10T11:52:50.593670+0000","last_peered":"2024-09-10T11:52:50.593670+0000","last_clean":"2024-09-10T11:52:50.593670+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:52:50.593670+0000","last_undegraded":"2024-09-10T11:52:50.593670+0000","last_fullsized":"2024-09-10T11:52:50.593670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-10T11:52:50.593483+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-10T11:52:50.593483+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.593483+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:08.443034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.323522+0000","last_change":"2024-09-10T11:52:51.323522+0000","last_active":"2024-09-10T11:52:51.323522+0000","last_peered":"2024-09-10T11:52:51.323522+0000","last_clean":"2024-09-10T11:52:51.323522+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:52:51.323522+0000","last_undegraded":"2024-09-10T11:52:51.323522+0000","last_fullsized":"2024-09-10T11:52:51.323522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.323319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.323319+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.323319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:38.374324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.939184+0000","last_change":"2024-09-10T11:52:47.939184+0000","last_active":"2024-09-10T11:52:47.939184+0000","last_peered":"2024-09-10T11:52:47.939184+0000","last_clean":"2024-09-10T11:52:47.939184+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:52:47.939184+0000","last_undegraded":"2024-09-10T11:52:47.939184+0000","last_fullsized":"2024-09-10T11:52:47.939184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.939001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.939001+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.939001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:30.051075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.653277+0000","last_change":"2024-09-10T11:52:53.653277+0000","last_active":"2024-09-10T11:52:53.653277+0000","last_peered":"2024-09-10T11:52:53.653277+0000","last_clean":"2024-09-10T11:52:53.653277+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:52:53.653277+0000","last_undegraded":"2024-09-10T11:52:53.653277+0000","last_fullsized":"2024-09-10T11:52:53.653277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.653071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.653071+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.653071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:03.197575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'74","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:43.087481+0000","last_change":"2024-09-10T11:52:43.087481+0000","last_active":"2024-09-10T11:52:43.087481+0000","last_peered":"2024-09-10T11:52:43.087481+0000","last_clean":"2024-09-10T11:52:43.087481+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:52:43.087481+0000","last_undegraded":"2024-09-10T11:52:43.087481+0000","last_fullsized":"2024-09-10T11:52:43.087481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-09-10T11:52:43.087397+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-09-10T11:52:43.087397+0000","last_clean_scrub_stamp":"2024-09-10T11:52:43.087397+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:22.812999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.624034+0000","last_change":"2024-09-10T11:52:45.624034+0000","last_active":"2024-09-10T11:52:45.624034+0000","last_peered":"2024-09-10T11:52:45.624034+0000","last_clean":"2024-09-10T11:52:45.624034+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:52:45.624034+0000","last_undegraded":"2024-09-10T11:52:45.624034+0000","last_fullsized":"2024-09-10T11:52:45.624034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.623844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.623844+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.623844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:24.927092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.104327+0000","last_change":"2024-09-10T11:52:51.104327+0000","last_active":"2024-09-10T11:52:51.104327+0000","last_peered":"2024-09-10T11:52:51.104327+0000","last_clean":"2024-09-10T11:52:51.104327+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:52:51.104327+0000","last_undegraded":"2024-09-10T11:52:51.104327+0000","last_fullsized":"2024-09-10T11:52:51.104327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.104229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.104229+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.104229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:25.978709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.639254+0000","last_change":"2024-09-10T11:52:44.639254+0000","last_active":"2024-09-10T11:52:44.639254+0000","last_peered":"2024-09-10T11:52:44.639254+0000","last_clean":"2024-09-10T11:52:44.639254+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:52:44.639254+0000","last_undegraded":"2024-09-10T11:52:44.639254+0000","last_fullsized":"2024-09-10T11:52:44.639254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.639055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.639055+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.639055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:25.618013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.936246+0000","last_change":"2024-09-10T11:52:48.936246+0000","last_active":"2024-09-10T11:52:48.936246+0000","last_peered":"2024-09-10T11:52:48.936246+0000","last_clean":"2024-09-10T11:52:48.936246+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:52:48.936246+0000","last_undegraded":"2024-09-10T11:52:48.936246+0000","last_fullsized":"2024-09-10T11:52:48.936246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.936063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.936063+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.936063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:11.991693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.193565+0000","last_change":"2024-09-10T11:52:51.193565+0000","last_active":"2024-09-10T11:52:51.193565+0000","last_peered":"2024-09-10T11:52:51.193565+0000","last_clean":"2024-09-10T11:52:51.193565+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:52:51.193565+0000","last_undegraded":"2024-09-10T11:52:51.193565+0000","last_fullsized":"2024-09-10T11:52:51.193565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.193438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.193438+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.193438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:16.633300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.656645+0000","last_change":"2024-09-10T11:52:48.656645+0000","last_active":"2024-09-10T11:52:48.656645+0000","last_peered":"2024-09-10T11:52:48.656645+0000","last_clean":"2024-09-10T11:52:48.656645+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:52:48.656645+0000","last_undegraded":"2024-09-10T11:52:48.656645+0000","last_fullsized":"2024-09-10T11:52:48.656645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.656433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.656433+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.656433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:47.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.635032+0000","last_change":"2024-09-10T11:52:46.635032+0000","last_active":"2024-09-10T11:52:46.635032+0000","last_peered":"2024-09-10T11:52:46.635032+0000","last_clean":"2024-09-10T11:52:46.635032+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:52:46.635032+0000","last_undegraded":"2024-09-10T11:52:46.635032+0000","last_fullsized":"2024-09-10T11:52:46.635032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.634846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.634846+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.634846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:29.165075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.250829+0000","last_change":"2024-09-10T11:52:46.250829+0000","last_active":"2024-09-10T11:52:46.250829+0000","last_peered":"2024-09-10T11:52:46.250829+0000","last_clean":"2024-09-10T11:52:46.250829+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:52:46.250829+0000","last_undegraded":"2024-09-10T11:52:46.250829+0000","last_fullsized":"2024-09-10T11:52:46.250829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.250640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.250640+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.250640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.100191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.659600+0000","last_change":"2024-09-10T11:52:46.659600+0000","last_active":"2024-09-10T11:52:46.659600+0000","last_peered":"2024-09-10T11:52:46.659600+0000","last_clean":"2024-09-10T11:52:46.659600+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:52:46.659600+0000","last_undegraded":"2024-09-10T11:52:46.659600+0000","last_fullsized":"2024-09-10T11:52:46.659600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.659386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.659386+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.659386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:18.172574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.055071+0000","last_change":"2024-09-10T11:52:44.055071+0000","last_active":"2024-09-10T11:52:44.055071+0000","last_peered":"2024-09-10T11:52:44.055071+0000","last_clean":"2024-09-10T11:52:44.055071+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:52:44.055071+0000","last_undegraded":"2024-09-10T11:52:44.055071+0000","last_fullsized":"2024-09-10T11:52:44.055071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.054886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.054886+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.054886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:05.179902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.602673+0000","last_change":"2024-09-10T11:52:47.602673+0000","last_active":"2024-09-10T11:52:47.602673+0000","last_peered":"2024-09-10T11:52:47.602673+0000","last_clean":"2024-09-10T11:52:47.602673+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:52:47.602673+0000","last_undegraded":"2024-09-10T11:52:47.602673+0000","last_fullsized":"2024-09-10T11:52:47.602673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.602483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.602483+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.602483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:36.251078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.878024+0000","last_change":"2024-09-10T11:52:50.878024+0000","last_active":"2024-09-10T11:52:50.878024+0000","last_peered":"2024-09-10T11:52:50.878024+0000","last_clean":"2024-09-10T11:52:50.878024+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:52:50.878024+0000","last_undegraded":"2024-09-10T11:52:50.878024+0000","last_fullsized":"2024-09-10T11:52:50.878024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.877850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.877850+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.877850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:17.856010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'2","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.154825+0000","last_change":"2024-09-10T11:52:45.154825+0000","last_active":"2024-09-10T11:52:45.154825+0000","last_peered":"2024-09-10T11:52:45.154825+0000","last_clean":"2024-09-10T11:52:45.154825+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:52:45.154825+0000","last_undegraded":"2024-09-10T11:52:45.154825+0000","last_fullsized":"2024-09-10T11:52:45.154825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-10T11:52:45.154550+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-10T11:52:45.154550+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.154550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:46.511320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.201792+0000","last_change":"2024-09-10T11:52:54.201792+0000","last_active":"2024-09-10T11:52:54.201792+0000","last_peered":"2024-09-10T11:52:54.201792+0000","last_clean":"2024-09-10T11:52:54.201792+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:52:54.201792+0000","last_undegraded":"2024-09-10T11:52:54.201792+0000","last_fullsized":"2024-09-10T11:52:54.201792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.201609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.201609+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.201609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:43.630940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.638119+0000","last_change":"2024-09-10T11:52:48.638119+0000","last_active":"2024-09-10T11:52:48.638119+0000","last_peered":"2024-09-10T11:52:48.638119+0000","last_clean":"2024-09-10T11:52:48.638119+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:52:48.638119+0000","last_undegraded":"2024-09-10T11:52:48.638119+0000","last_fullsized":"2024-09-10T11:52:48.638119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:48.637924+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:48.637924+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.637924+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:09.053983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.055184+0000","last_change":"2024-09-10T11:52:49.055184+0000","last_active":"2024-09-10T11:52:49.055184+0000","last_peered":"2024-09-10T11:52:49.055184+0000","last_clean":"2024-09-10T11:52:49.055184+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:52:49.055184+0000","last_undegraded":"2024-09-10T11:52:49.055184+0000","last_fullsized":"2024-09-10T11:52:49.055184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.055012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.055012+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.055012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:53.575788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:43.296628+0000","last_change":"2024-09-10T11:52:43.296628+0000","last_active":"2024-09-10T11:52:43.296628+0000","last_peered":"2024-09-10T11:52:43.296628+0000","last_clean":"2024-09-10T11:52:43.296628+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:52:43.296628+0000","last_undegraded":"2024-09-10T11:52:43.296628+0000","last_fullsized":"2024-09-10T11:52:43.296628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:43.296454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:43.296454+0000","last_clean_scrub_stamp":"2024-09-10T11:52:43.296454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:10.877120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.606719+0000","last_change":"2024-09-10T11:52:52.606719+0000","last_active":"2024-09-10T11:52:52.606719+0000","last_peered":"2024-09-10T11:52:52.606719+0000","last_clean":"2024-09-10T11:52:52.606719+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:52:52.606719+0000","last_undegraded":"2024-09-10T11:52:52.606719+0000","last_fullsized":"2024-09-10T11:52:52.606719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.606497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.606497+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.606497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:33.658980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.110703+0000","last_change":"2024-09-10T11:52:47.110703+0000","last_active":"2024-09-10T11:52:47.110703+0000","last_peered":"2024-09-10T11:52:47.110703+0000","last_clean":"2024-09-10T11:52:47.110703+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:52:47.110703+0000","last_undegraded":"2024-09-10T11:52:47.110703+0000","last_fullsized":"2024-09-10T11:52:47.110703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.110500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.110500+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.110500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:07.698546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.148823+0000","last_change":"2024-09-10T11:52:52.148823+0000","last_active":"2024-09-10T11:52:52.148823+0000","last_peered":"2024-09-10T11:52:52.148823+0000","last_clean":"2024-09-10T11:52:52.148823+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:52:52.148823+0000","last_undegraded":"2024-09-10T11:52:52.148823+0000","last_fullsized":"2024-09-10T11:52:52.148823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.148644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.148644+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.148644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:53.504644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.915073+0000","last_change":"2024-09-10T11:52:45.915073+0000","last_active":"2024-09-10T11:52:45.915073+0000","last_peered":"2024-09-10T11:52:45.915073+0000","last_clean":"2024-09-10T11:52:45.915073+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:52:45.915073+0000","last_undegraded":"2024-09-10T11:52:45.915073+0000","last_fullsized":"2024-09-10T11:52:45.915073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.914888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.914888+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.914888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:06.409032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.209594+0000","last_change":"2024-09-10T11:52:48.209594+0000","last_active":"2024-09-10T11:52:48.209594+0000","last_peered":"2024-09-10T11:52:48.209594+0000","last_clean":"2024-09-10T11:52:48.209594+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:52:48.209594+0000","last_undegraded":"2024-09-10T11:52:48.209594+0000","last_fullsized":"2024-09-10T11:52:48.209594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.209369+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:39.992181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.599828+0000","last_change":"2024-09-10T11:52:49.599828+0000","last_active":"2024-09-10T11:52:49.599828+0000","last_peered":"2024-09-10T11:52:49.599828+0000","last_clean":"2024-09-10T11:52:49.599828+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:52:49.599828+0000","last_undegraded":"2024-09-10T11:52:49.599828+0000","last_fullsized":"2024-09-10T11:52:49.599828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:49.599643+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:49.599643+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.599643+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:54:29.613821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.693121+0000","last_change":"2024-09-10T11:52:56.693121+0000","last_active":"2024-09-10T11:52:56.693121+0000","last_peered":"2024-09-10T11:52:56.693121+0000","last_clean":"2024-09-10T11:52:56.693121+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:52:56.693121+0000","last_undegraded":"2024-09-10T11:52:56.693121+0000","last_fullsized":"2024-09-10T11:52:56.693121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.692853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.692853+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.692853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:53.634694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:59.764696+0000","last_change":"2024-09-10T11:52:59.764696+0000","last_active":"2024-09-10T11:52:59.764696+0000","last_peered":"2024-09-10T11:52:59.764696+0000","last_clean":"2024-09-10T11:52:59.764696+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:52:59.764696+0000","last_undegraded":"2024-09-10T11:52:59.764696+0000","last_fullsized":"2024-09-10T11:52:59.764696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:59.764506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:59.764506+0000","last_clean_scrub_stamp":"2024-09-10T11:52:59.764506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:30.769139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.297092+0000","last_change":"2024-09-10T11:52:48.297092+0000","last_active":"2024-09-10T11:52:48.297092+0000","last_peered":"2024-09-10T11:52:48.297092+0000","last_clean":"2024-09-10T11:52:48.297092+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:52:48.297092+0000","last_undegraded":"2024-09-10T11:52:48.297092+0000","last_fullsized":"2024-09-10T11:52:48.297092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:48.296855+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:48.296855+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.296855+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:05.017989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.160436+0000","last_change":"2024-09-10T11:52:48.160436+0000","last_active":"2024-09-10T11:52:48.160436+0000","last_peered":"2024-09-10T11:52:48.160436+0000","last_clean":"2024-09-10T11:52:48.160436+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:52:48.160436+0000","last_undegraded":"2024-09-10T11:52:48.160436+0000","last_fullsized":"2024-09-10T11:52:48.160436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.160257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.160257+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.160257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:01.860050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.299881+0000","last_change":"2024-09-10T11:52:47.299881+0000","last_active":"2024-09-10T11:52:47.299881+0000","last_peered":"2024-09-10T11:52:47.299881+0000","last_clean":"2024-09-10T11:52:47.299881+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:52:47.299881+0000","last_undegraded":"2024-09-10T11:52:47.299881+0000","last_fullsized":"2024-09-10T11:52:47.299881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:47.299661+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:47.299661+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.299661+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:47.702508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.685415+0000","last_change":"2024-09-10T11:52:55.685415+0000","last_active":"2024-09-10T11:52:55.685415+0000","last_peered":"2024-09-10T11:52:55.685415+0000","last_clean":"2024-09-10T11:52:55.685415+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:52:55.685415+0000","last_undegraded":"2024-09-10T11:52:55.685415+0000","last_fullsized":"2024-09-10T11:52:55.685415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.685226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.685226+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.685226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:16.101285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.649853+0000","last_change":"2024-09-10T11:52:47.649853+0000","last_active":"2024-09-10T11:52:47.649853+0000","last_peered":"2024-09-10T11:52:47.649853+0000","last_clean":"2024-09-10T11:52:47.649853+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:52:47.649853+0000","last_undegraded":"2024-09-10T11:52:47.649853+0000","last_fullsized":"2024-09-10T11:52:47.649853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-09-10T11:52:47.649650+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-09-10T11:52:47.649650+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.649650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:21.114700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.657025+0000","last_change":"2024-09-10T11:52:52.657025+0000","last_active":"2024-09-10T11:52:52.657025+0000","last_peered":"2024-09-10T11:52:52.657025+0000","last_clean":"2024-09-10T11:52:52.657025+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:52:52.657025+0000","last_undegraded":"2024-09-10T11:52:52.657025+0000","last_fullsized":"2024-09-10T11:52:52.657025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.656807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.656807+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.656807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'6","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.097915+0000","last_change":"2024-09-10T11:52:50.097915+0000","last_active":"2024-09-10T11:52:50.097915+0000","last_peered":"2024-09-10T11:52:50.097915+0000","last_clean":"2024-09-10T11:52:50.097915+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:52:50.097915+0000","last_undegraded":"2024-09-10T11:52:50.097915+0000","last_fullsized":"2024-09-10T11:52:50.097915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-09-10T11:52:50.097725+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-09-10T11:52:50.097725+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.097725+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:22.198325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":93272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":683608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":95432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":94760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":258048,"data_stored":93148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:53:06.162 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:53:06.162 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:53:06.163 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:53:06.163 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T11:47:26.709871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=47, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:53:06.164 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T11:53:21.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:21.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:26.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:53:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1830093927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f401528c0 msgr2=0x7f3f400b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1830093927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f401528c0 0x7f3f400b4f70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3f400aeaa0 tx=0x7f3f3c01c540 comp rx=0 tx=0).stop 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1830093927 shutdown_connections 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1830093927 >> v2:172.21.15.112:3300/0 conn(0x7f3f4006e720 0x7f3f4015f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1830093927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f400b54b0 0x7f3f4006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1830093927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f401528c0 0x7f3f400b4f70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1830093927 >> 172.21.15.78:0/1830093927 conn(0x7f3f400cf7c0 msgr2=0x7f3f400cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1830093927 shutdown_connections 2024-09-10T11:53:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1830093927 wait complete. 2024-09-10T11:53:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 Processor -- start 2024-09-10T11:53:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- start start 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 0x7f3f40144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f400b54b0 0x7f3f400b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f401528c0 0x7f3f400b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400ce410 con 0x7f3f4006e720 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400ce290 con 0x7f3f400b54b0 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3f400ce590 con 0x7f3f401528c0 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 0x7f3f40144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 0x7f3f40144400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56140/0 (socket says 172.21.15.78:56140) 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 -- 172.21.15.78:0/1818484804 learned_addr learned my addr 172.21.15.78:0/1818484804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f37fff640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f400b54b0 0x7f3f400b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f45642640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f401528c0 0x7f3f400b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 -- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f401528c0 msgr2=0x7f3f400b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f401528c0 0x7f3f400b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 -- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f400b54b0 msgr2=0x7f3f400b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f400b54b0 0x7f3f400b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 -- 172.21.15.78:0/1818484804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f400cbe40 con 0x7f3f4006e720 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f37fff640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f400b54b0 0x7f3f400b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f44e41640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 0x7f3f40144400 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009850 tx=0x7f3f3c0a8610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0042c0 con 0x7f3f4006e720 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f3c003600 con 0x7f3f4006e720 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4014efc0 con 0x7f3f4006e720 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003a50 con 0x7f3f4006e720 2024-09-10T11:53:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.310+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4014f580 con 0x7f3f4006e720 2024-09-10T11:53:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.314+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4006e1e0 con 0x7f3f4006e720 2024-09-10T11:53:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.314+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f3f3c003bf0 con 0x7f3f4006e720 2024-09-10T11:53:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.314+0000 7f3f357fa640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3f2c06f710 0x7f3f2c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.314+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3f3c12a3f0 con 0x7f3f4006e720 2024-09-10T11:53:26.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.314+0000 7f3f37fff640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3f2c06f710 0x7f3f2c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.314+0000 7f3f37fff640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3f2c06f710 0x7f3f2c071bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3f4014a330 tx=0x7f3f30005ed0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:53:26.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.318+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f3f3c0ac030 con 0x7f3f4006e720 2024-09-10T11:53:26.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.466+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 --> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f4015d660 con 0x7f3f2c06f710 2024-09-10T11:53:26.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.478+0000 7f3f357fa640 1 -- 172.21.15.78:0/1818484804 <== mgr.4120 v2:172.21.15.112:6800/4127887797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251874 (secure 0 0 0) 0x7f3f4015d660 con 0x7f3f2c06f710 2024-09-10T11:53:26.481 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T11:53:26.483 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3f2c06f710 msgr2=0x7f3f2c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3f2c06f710 0x7f3f2c071bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3f4014a330 tx=0x7f3f30005ed0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 msgr2=0x7f3f40144400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 0x7f3f40144400 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009850 tx=0x7f3f3c0a8610 comp rx=0 tx=0).stop 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 shutdown_connections 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f400b54b0 0x7f3f400b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f3f2c06f710 0x7f3f2c071bd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f401528c0 0x7f3f400b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 --2- 172.21.15.78:0/1818484804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4006e720 0x7f3f40144400 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 >> 172.21.15.78:0/1818484804 conn(0x7f3f400cf7c0 msgr2=0x7f3f4014db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:53:26.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 shutdown_connections 2024-09-10T11:53:26.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.482+0000 7f3f470a5640 1 -- 172.21.15.78:0/1818484804 wait complete. 2024-09-10T11:53:26.498 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-10T11:53:25.377327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223592,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751128,"statfs":{"total":773094113280,"available":772865155072,"internally_reserved":0,"allocated":3317760,"data_stored":1930740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004491"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:57.257115+0000","last_change":"2024-09-10T11:52:57.257115+0000","last_active":"2024-09-10T11:52:57.257115+0000","last_peered":"2024-09-10T11:52:57.257115+0000","last_clean":"2024-09-10T11:52:57.257115+0000","last_became_active":"2024-09-10T11:47:27.768533+0000","last_became_peered":"2024-09-10T11:47:27.768533+0000","last_unstale":"2024-09-10T11:52:57.257115+0000","last_undegraded":"2024-09-10T11:52:57.257115+0000","last_fullsized":"2024-09-10T11:52:57.257115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:57.256940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:57.256940+0000","last_clean_scrub_stamp":"2024-09-10T11:52:57.256940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:20.056153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:00.715889+0000","last_change":"2024-09-10T11:53:00.715889+0000","last_active":"2024-09-10T11:53:00.715889+0000","last_peered":"2024-09-10T11:53:00.715889+0000","last_clean":"2024-09-10T11:53:00.715889+0000","last_became_active":"2024-09-10T11:47:27.772060+0000","last_became_peered":"2024-09-10T11:47:27.772060+0000","last_unstale":"2024-09-10T11:53:00.715889+0000","last_undegraded":"2024-09-10T11:53:00.715889+0000","last_fullsized":"2024-09-10T11:53:00.715889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:00.715664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:00.715664+0000","last_clean_scrub_stamp":"2024-09-10T11:53:00.715664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:11.355277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:59.695516+0000","last_change":"2024-09-10T11:52:59.695516+0000","last_active":"2024-09-10T11:52:59.695516+0000","last_peered":"2024-09-10T11:52:59.695516+0000","last_clean":"2024-09-10T11:52:59.695516+0000","last_became_active":"2024-09-10T11:47:27.748371+0000","last_became_peered":"2024-09-10T11:47:27.748371+0000","last_unstale":"2024-09-10T11:52:59.695516+0000","last_undegraded":"2024-09-10T11:52:59.695516+0000","last_fullsized":"2024-09-10T11:52:59.695516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:59.695322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:59.695322+0000","last_clean_scrub_stamp":"2024-09-10T11:52:59.695322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:54.913889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.091579+0000","last_change":"2024-09-10T11:52:49.091579+0000","last_active":"2024-09-10T11:52:49.091579+0000","last_peered":"2024-09-10T11:52:49.091579+0000","last_clean":"2024-09-10T11:52:49.091579+0000","last_became_active":"2024-09-10T11:47:27.747554+0000","last_became_peered":"2024-09-10T11:47:27.747554+0000","last_unstale":"2024-09-10T11:52:49.091579+0000","last_undegraded":"2024-09-10T11:52:49.091579+0000","last_fullsized":"2024-09-10T11:52:49.091579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.091358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.091358+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.091358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:14.787593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.197232+0000","last_change":"2024-09-10T11:52:52.196978+0000","last_active":"2024-09-10T11:52:52.197232+0000","last_peered":"2024-09-10T11:52:52.197232+0000","last_clean":"2024-09-10T11:52:52.197232+0000","last_became_active":"2024-09-10T11:48:08.361135+0000","last_became_peered":"2024-09-10T11:48:08.361135+0000","last_unstale":"2024-09-10T11:52:52.197232+0000","last_undegraded":"2024-09-10T11:52:52.197232+0000","last_fullsized":"2024-09-10T11:52:52.197232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.196692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.196692+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.196692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.751195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.075877+0000","last_change":"2024-09-10T11:52:47.075877+0000","last_active":"2024-09-10T11:52:47.075877+0000","last_peered":"2024-09-10T11:52:47.075877+0000","last_clean":"2024-09-10T11:52:47.075877+0000","last_became_active":"2024-09-10T11:47:27.746418+0000","last_became_peered":"2024-09-10T11:47:27.746418+0000","last_unstale":"2024-09-10T11:52:47.075877+0000","last_undegraded":"2024-09-10T11:52:47.075877+0000","last_fullsized":"2024-09-10T11:52:47.075877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.075665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.075665+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.075665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:12.515528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.304959+0000","last_change":"2024-09-10T11:52:56.304959+0000","last_active":"2024-09-10T11:52:56.304959+0000","last_peered":"2024-09-10T11:52:56.304959+0000","last_clean":"2024-09-10T11:52:56.304959+0000","last_became_active":"2024-09-10T11:47:27.770438+0000","last_became_peered":"2024-09-10T11:47:27.770438+0000","last_unstale":"2024-09-10T11:52:56.304959+0000","last_undegraded":"2024-09-10T11:52:56.304959+0000","last_fullsized":"2024-09-10T11:52:56.304959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.304774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.304774+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.304774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:37.357256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:58.670269+0000","last_change":"2024-09-10T11:52:58.670269+0000","last_active":"2024-09-10T11:52:58.670269+0000","last_peered":"2024-09-10T11:52:58.670269+0000","last_clean":"2024-09-10T11:52:58.670269+0000","last_became_active":"2024-09-10T11:47:27.750224+0000","last_became_peered":"2024-09-10T11:47:27.750224+0000","last_unstale":"2024-09-10T11:52:58.670269+0000","last_undegraded":"2024-09-10T11:52:58.670269+0000","last_fullsized":"2024-09-10T11:52:58.670269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:58.670089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:58.670089+0000","last_clean_scrub_stamp":"2024-09-10T11:52:58.670089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:22.375489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.092894+0000","last_change":"2024-09-10T11:52:46.092894+0000","last_active":"2024-09-10T11:52:46.092894+0000","last_peered":"2024-09-10T11:52:46.092894+0000","last_clean":"2024-09-10T11:52:46.092894+0000","last_became_active":"2024-09-10T11:47:27.761558+0000","last_became_peered":"2024-09-10T11:47:27.761558+0000","last_unstale":"2024-09-10T11:52:46.092894+0000","last_undegraded":"2024-09-10T11:52:46.092894+0000","last_fullsized":"2024-09-10T11:52:46.092894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.092723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.092723+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.092723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.086184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.316751+0000","last_change":"2024-09-10T11:52:54.316751+0000","last_active":"2024-09-10T11:52:54.316751+0000","last_peered":"2024-09-10T11:52:54.316751+0000","last_clean":"2024-09-10T11:52:54.316751+0000","last_became_active":"2024-09-10T11:47:27.771280+0000","last_became_peered":"2024-09-10T11:47:27.771280+0000","last_unstale":"2024-09-10T11:52:54.316751+0000","last_undegraded":"2024-09-10T11:52:54.316751+0000","last_fullsized":"2024-09-10T11:52:54.316751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.316526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.316526+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.316526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:07.019501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.281200+0000","last_change":"2024-09-10T11:52:55.281200+0000","last_active":"2024-09-10T11:52:55.281200+0000","last_peered":"2024-09-10T11:52:55.281200+0000","last_clean":"2024-09-10T11:52:55.281200+0000","last_became_active":"2024-09-10T11:47:27.770731+0000","last_became_peered":"2024-09-10T11:47:27.770731+0000","last_unstale":"2024-09-10T11:52:55.281200+0000","last_undegraded":"2024-09-10T11:52:55.281200+0000","last_fullsized":"2024-09-10T11:52:55.281200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.281022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.281022+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.281022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:46.904174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:58.294434+0000","last_change":"2024-09-10T11:52:58.294434+0000","last_active":"2024-09-10T11:52:58.294434+0000","last_peered":"2024-09-10T11:52:58.294434+0000","last_clean":"2024-09-10T11:52:58.294434+0000","last_became_active":"2024-09-10T11:47:27.778115+0000","last_became_peered":"2024-09-10T11:47:27.778115+0000","last_unstale":"2024-09-10T11:52:58.294434+0000","last_undegraded":"2024-09-10T11:52:58.294434+0000","last_fullsized":"2024-09-10T11:52:58.294434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:58.294231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:58.294231+0000","last_clean_scrub_stamp":"2024-09-10T11:52:58.294231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:49.213009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.879146+0000","last_change":"2024-09-10T11:52:54.879146+0000","last_active":"2024-09-10T11:52:54.879146+0000","last_peered":"2024-09-10T11:52:54.879146+0000","last_clean":"2024-09-10T11:52:54.879146+0000","last_became_active":"2024-09-10T11:47:27.782559+0000","last_became_peered":"2024-09-10T11:47:27.782559+0000","last_unstale":"2024-09-10T11:52:54.879146+0000","last_undegraded":"2024-09-10T11:52:54.879146+0000","last_fullsized":"2024-09-10T11:52:54.879146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.878958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.878958+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.878958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:04.026651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.827867+0000","last_change":"2024-09-10T11:52:52.827867+0000","last_active":"2024-09-10T11:52:52.827867+0000","last_peered":"2024-09-10T11:52:52.827867+0000","last_clean":"2024-09-10T11:52:52.827867+0000","last_became_active":"2024-09-10T11:47:27.783110+0000","last_became_peered":"2024-09-10T11:47:27.783110+0000","last_unstale":"2024-09-10T11:52:52.827867+0000","last_undegraded":"2024-09-10T11:52:52.827867+0000","last_fullsized":"2024-09-10T11:52:52.827867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.827629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.827629+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.827629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:53.083225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:57.641930+0000","last_change":"2024-09-10T11:52:57.641930+0000","last_active":"2024-09-10T11:52:57.641930+0000","last_peered":"2024-09-10T11:52:57.641930+0000","last_clean":"2024-09-10T11:52:57.641930+0000","last_became_active":"2024-09-10T11:47:27.755975+0000","last_became_peered":"2024-09-10T11:47:27.755975+0000","last_unstale":"2024-09-10T11:52:57.641930+0000","last_undegraded":"2024-09-10T11:52:57.641930+0000","last_fullsized":"2024-09-10T11:52:57.641930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:57.641749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:57.641749+0000","last_clean_scrub_stamp":"2024-09-10T11:52:57.641749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:53.265424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:04.715078+0000","last_change":"2024-09-10T11:53:04.715078+0000","last_active":"2024-09-10T11:53:04.715078+0000","last_peered":"2024-09-10T11:53:04.715078+0000","last_clean":"2024-09-10T11:53:04.715078+0000","last_became_active":"2024-09-10T11:47:27.768448+0000","last_became_peered":"2024-09-10T11:47:27.768448+0000","last_unstale":"2024-09-10T11:53:04.715078+0000","last_undegraded":"2024-09-10T11:53:04.715078+0000","last_fullsized":"2024-09-10T11:53:04.715078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:04.714881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:04.714881+0000","last_clean_scrub_stamp":"2024-09-10T11:53:04.714881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:52.662193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:03.735892+0000","last_change":"2024-09-10T11:53:03.735892+0000","last_active":"2024-09-10T11:53:03.735892+0000","last_peered":"2024-09-10T11:53:03.735892+0000","last_clean":"2024-09-10T11:53:03.735892+0000","last_became_active":"2024-09-10T11:47:27.755464+0000","last_became_peered":"2024-09-10T11:47:27.755464+0000","last_unstale":"2024-09-10T11:53:03.735892+0000","last_undegraded":"2024-09-10T11:53:03.735892+0000","last_fullsized":"2024-09-10T11:53:03.735892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:03.735690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:03.735690+0000","last_clean_scrub_stamp":"2024-09-10T11:53:03.735690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:29.347785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.242757+0000","last_change":"2024-09-10T11:52:49.242757+0000","last_active":"2024-09-10T11:52:49.242757+0000","last_peered":"2024-09-10T11:52:49.242757+0000","last_clean":"2024-09-10T11:52:49.242757+0000","last_became_active":"2024-09-10T11:47:27.771260+0000","last_became_peered":"2024-09-10T11:47:27.771260+0000","last_unstale":"2024-09-10T11:52:49.242757+0000","last_undegraded":"2024-09-10T11:52:49.242757+0000","last_fullsized":"2024-09-10T11:52:49.242757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.242581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.242581+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.242581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:42.672415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:02.752547+0000","last_change":"2024-09-10T11:53:02.752547+0000","last_active":"2024-09-10T11:53:02.752547+0000","last_peered":"2024-09-10T11:53:02.752547+0000","last_clean":"2024-09-10T11:53:02.752547+0000","last_became_active":"2024-09-10T11:47:27.742643+0000","last_became_peered":"2024-09-10T11:47:27.742643+0000","last_unstale":"2024-09-10T11:53:02.752547+0000","last_undegraded":"2024-09-10T11:53:02.752547+0000","last_fullsized":"2024-09-10T11:53:02.752547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:02.752256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:02.752256+0000","last_clean_scrub_stamp":"2024-09-10T11:53:02.752256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:58.745878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.303302+0000","last_change":"2024-09-10T11:52:53.303302+0000","last_active":"2024-09-10T11:52:53.303302+0000","last_peered":"2024-09-10T11:52:53.303302+0000","last_clean":"2024-09-10T11:52:53.303302+0000","last_became_active":"2024-09-10T11:47:27.777648+0000","last_became_peered":"2024-09-10T11:47:27.777648+0000","last_unstale":"2024-09-10T11:52:53.303302+0000","last_undegraded":"2024-09-10T11:52:53.303302+0000","last_fullsized":"2024-09-10T11:52:53.303302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.303094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.303094+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.303094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:15.652494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.247238+0000","last_change":"2024-09-10T11:52:56.247238+0000","last_active":"2024-09-10T11:52:56.247238+0000","last_peered":"2024-09-10T11:52:56.247238+0000","last_clean":"2024-09-10T11:52:56.247238+0000","last_became_active":"2024-09-10T11:47:27.749117+0000","last_became_peered":"2024-09-10T11:47:27.749117+0000","last_unstale":"2024-09-10T11:52:56.247238+0000","last_undegraded":"2024-09-10T11:52:56.247238+0000","last_fullsized":"2024-09-10T11:52:56.247238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.247021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.247021+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.247021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:55.151933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.148022+0000","last_change":"2024-09-10T11:52:49.148022+0000","last_active":"2024-09-10T11:52:49.148022+0000","last_peered":"2024-09-10T11:52:49.148022+0000","last_clean":"2024-09-10T11:52:49.148022+0000","last_became_active":"2024-09-10T11:47:27.758021+0000","last_became_peered":"2024-09-10T11:47:27.758021+0000","last_unstale":"2024-09-10T11:52:49.148022+0000","last_undegraded":"2024-09-10T11:52:49.148022+0000","last_fullsized":"2024-09-10T11:52:49.148022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.147763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.147763+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.147763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:38.877769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.691120+0000","last_change":"2024-09-10T11:52:56.691120+0000","last_active":"2024-09-10T11:52:56.691120+0000","last_peered":"2024-09-10T11:52:56.691120+0000","last_clean":"2024-09-10T11:52:56.691120+0000","last_became_active":"2024-09-10T11:47:27.743633+0000","last_became_peered":"2024-09-10T11:47:27.743633+0000","last_unstale":"2024-09-10T11:52:56.691120+0000","last_undegraded":"2024-09-10T11:52:56.691120+0000","last_fullsized":"2024-09-10T11:52:56.691120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.690923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.690923+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.690923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:54:36.705101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:00.763960+0000","last_change":"2024-09-10T11:53:00.763960+0000","last_active":"2024-09-10T11:53:00.763960+0000","last_peered":"2024-09-10T11:53:00.763960+0000","last_clean":"2024-09-10T11:53:00.763960+0000","last_became_active":"2024-09-10T11:47:27.761052+0000","last_became_peered":"2024-09-10T11:47:27.761052+0000","last_unstale":"2024-09-10T11:53:00.763960+0000","last_undegraded":"2024-09-10T11:53:00.763960+0000","last_fullsized":"2024-09-10T11:53:00.763960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:00.763778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:00.763778+0000","last_clean_scrub_stamp":"2024-09-10T11:53:00.763778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:40.384509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.681326+0000","last_change":"2024-09-10T11:52:54.681326+0000","last_active":"2024-09-10T11:52:54.681326+0000","last_peered":"2024-09-10T11:52:54.681326+0000","last_clean":"2024-09-10T11:52:54.681326+0000","last_became_active":"2024-09-10T11:47:27.760261+0000","last_became_peered":"2024-09-10T11:47:27.760261+0000","last_unstale":"2024-09-10T11:52:54.681326+0000","last_undegraded":"2024-09-10T11:52:54.681326+0000","last_fullsized":"2024-09-10T11:52:54.681326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.681122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.681122+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.681122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:43.329717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.092073+0000","last_change":"2024-09-10T11:52:48.092073+0000","last_active":"2024-09-10T11:52:48.092073+0000","last_peered":"2024-09-10T11:52:48.092073+0000","last_clean":"2024-09-10T11:52:48.092073+0000","last_became_active":"2024-09-10T11:47:27.755599+0000","last_became_peered":"2024-09-10T11:47:27.755599+0000","last_unstale":"2024-09-10T11:52:48.092073+0000","last_undegraded":"2024-09-10T11:52:48.092073+0000","last_fullsized":"2024-09-10T11:52:48.092073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.091892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.091892+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.091892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:01.791684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.858722+0000","last_change":"2024-09-10T11:52:53.858722+0000","last_active":"2024-09-10T11:52:53.858722+0000","last_peered":"2024-09-10T11:52:53.858722+0000","last_clean":"2024-09-10T11:52:53.858722+0000","last_became_active":"2024-09-10T11:47:27.770257+0000","last_became_peered":"2024-09-10T11:47:27.770257+0000","last_unstale":"2024-09-10T11:52:53.858722+0000","last_undegraded":"2024-09-10T11:52:53.858722+0000","last_fullsized":"2024-09-10T11:52:53.858722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.858519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.858519+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.858519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:30.352780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.835414+0000","last_change":"2024-09-10T11:52:51.835414+0000","last_active":"2024-09-10T11:52:51.835414+0000","last_peered":"2024-09-10T11:52:51.835414+0000","last_clean":"2024-09-10T11:52:51.835414+0000","last_became_active":"2024-09-10T11:47:27.765631+0000","last_became_peered":"2024-09-10T11:47:27.765631+0000","last_unstale":"2024-09-10T11:52:51.835414+0000","last_undegraded":"2024-09-10T11:52:51.835414+0000","last_fullsized":"2024-09-10T11:52:51.835414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.835241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.835241+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.835241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:50.195447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.633659+0000","last_change":"2024-09-10T11:52:53.633659+0000","last_active":"2024-09-10T11:52:53.633659+0000","last_peered":"2024-09-10T11:52:53.633659+0000","last_clean":"2024-09-10T11:52:53.633659+0000","last_became_active":"2024-09-10T11:47:27.760055+0000","last_became_peered":"2024-09-10T11:47:27.760055+0000","last_unstale":"2024-09-10T11:52:53.633659+0000","last_undegraded":"2024-09-10T11:52:53.633659+0000","last_fullsized":"2024-09-10T11:52:53.633659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.633442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.633442+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.633442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:26.709663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:53:01.729885+0000","last_change":"2024-09-10T11:53:01.729885+0000","last_active":"2024-09-10T11:53:01.729885+0000","last_peered":"2024-09-10T11:53:01.729885+0000","last_clean":"2024-09-10T11:53:01.729885+0000","last_became_active":"2024-09-10T11:47:27.761220+0000","last_became_peered":"2024-09-10T11:47:27.761220+0000","last_unstale":"2024-09-10T11:53:01.729885+0000","last_undegraded":"2024-09-10T11:53:01.729885+0000","last_fullsized":"2024-09-10T11:53:01.729885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:53:01.729666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:53:01.729666+0000","last_clean_scrub_stamp":"2024-09-10T11:53:01.729666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:02.099612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.197131+0000","last_change":"2024-09-10T11:52:50.197131+0000","last_active":"2024-09-10T11:52:50.197131+0000","last_peered":"2024-09-10T11:52:50.197131+0000","last_clean":"2024-09-10T11:52:50.197131+0000","last_became_active":"2024-09-10T11:47:27.767023+0000","last_became_peered":"2024-09-10T11:47:27.767023+0000","last_unstale":"2024-09-10T11:52:50.197131+0000","last_undegraded":"2024-09-10T11:52:50.197131+0000","last_fullsized":"2024-09-10T11:52:50.197131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.196834+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.196834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:46.264332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.083746+0000","last_change":"2024-09-10T11:52:50.083746+0000","last_active":"2024-09-10T11:52:50.083746+0000","last_peered":"2024-09-10T11:52:50.083746+0000","last_clean":"2024-09-10T11:52:50.083746+0000","last_became_active":"2024-09-10T11:47:27.781498+0000","last_became_peered":"2024-09-10T11:47:27.781498+0000","last_unstale":"2024-09-10T11:52:50.083746+0000","last_undegraded":"2024-09-10T11:52:50.083746+0000","last_fullsized":"2024-09-10T11:52:50.083746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.083553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.083553+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.083553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:32.636850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.122336+0000","last_change":"2024-09-10T11:52:47.122336+0000","last_active":"2024-09-10T11:52:47.122336+0000","last_peered":"2024-09-10T11:52:47.122336+0000","last_clean":"2024-09-10T11:52:47.122336+0000","last_became_active":"2024-09-10T11:47:27.759591+0000","last_became_peered":"2024-09-10T11:47:27.759591+0000","last_unstale":"2024-09-10T11:52:47.122336+0000","last_undegraded":"2024-09-10T11:52:47.122336+0000","last_fullsized":"2024-09-10T11:52:47.122336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.122154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.122154+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.122154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:12.562016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.666336+0000","last_change":"2024-09-10T11:52:45.666336+0000","last_active":"2024-09-10T11:52:45.666336+0000","last_peered":"2024-09-10T11:52:45.666336+0000","last_clean":"2024-09-10T11:52:45.666336+0000","last_became_active":"2024-09-10T11:47:26.755282+0000","last_became_peered":"2024-09-10T11:47:26.755282+0000","last_unstale":"2024-09-10T11:52:45.666336+0000","last_undegraded":"2024-09-10T11:52:45.666336+0000","last_fullsized":"2024-09-10T11:52:45.666336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-09-10T11:52:45.666123+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-09-10T11:52:45.666123+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.666123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:41.665619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.222318+0000","last_change":"2024-09-10T11:52:55.222318+0000","last_active":"2024-09-10T11:52:55.222318+0000","last_peered":"2024-09-10T11:52:55.222318+0000","last_clean":"2024-09-10T11:52:55.222318+0000","last_became_active":"2024-09-10T11:47:27.788526+0000","last_became_peered":"2024-09-10T11:47:27.788526+0000","last_unstale":"2024-09-10T11:52:55.222318+0000","last_undegraded":"2024-09-10T11:52:55.222318+0000","last_fullsized":"2024-09-10T11:52:55.222318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.222121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.222121+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.222121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:22.802787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.655967+0000","last_change":"2024-09-10T11:52:54.655967+0000","last_active":"2024-09-10T11:52:54.655967+0000","last_peered":"2024-09-10T11:52:54.655967+0000","last_clean":"2024-09-10T11:52:54.655967+0000","last_became_active":"2024-09-10T11:47:26.748985+0000","last_became_peered":"2024-09-10T11:47:26.748985+0000","last_unstale":"2024-09-10T11:52:54.655967+0000","last_undegraded":"2024-09-10T11:52:54.655967+0000","last_fullsized":"2024-09-10T11:52:54.655967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-09-10T11:52:54.655739+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-09-10T11:52:54.655739+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.655739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:49.860376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.942793+0000","last_change":"2024-09-10T11:52:46.942793+0000","last_active":"2024-09-10T11:52:46.942793+0000","last_peered":"2024-09-10T11:52:46.942793+0000","last_clean":"2024-09-10T11:52:46.942793+0000","last_became_active":"2024-09-10T11:47:26.750422+0000","last_became_peered":"2024-09-10T11:47:26.750422+0000","last_unstale":"2024-09-10T11:52:46.942793+0000","last_undegraded":"2024-09-10T11:52:46.942793+0000","last_fullsized":"2024-09-10T11:52:46.942793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.942617+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.942617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:10.603892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.632661+0000","last_change":"2024-09-10T11:52:51.632661+0000","last_active":"2024-09-10T11:52:51.632661+0000","last_peered":"2024-09-10T11:52:51.632661+0000","last_clean":"2024-09-10T11:52:51.632661+0000","last_became_active":"2024-09-10T11:47:27.772160+0000","last_became_peered":"2024-09-10T11:47:27.772160+0000","last_unstale":"2024-09-10T11:52:51.632661+0000","last_undegraded":"2024-09-10T11:52:51.632661+0000","last_fullsized":"2024-09-10T11:52:51.632661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.632434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.632434+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.632434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:22.570377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.602341+0000","last_change":"2024-09-10T11:52:50.602341+0000","last_active":"2024-09-10T11:52:50.602341+0000","last_peered":"2024-09-10T11:52:50.602341+0000","last_clean":"2024-09-10T11:52:50.602341+0000","last_became_active":"2024-09-10T11:47:26.741547+0000","last_became_peered":"2024-09-10T11:47:26.741547+0000","last_unstale":"2024-09-10T11:52:50.602341+0000","last_undegraded":"2024-09-10T11:52:50.602341+0000","last_fullsized":"2024-09-10T11:52:50.602341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.602163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.602163+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.602163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:46.225838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.173470+0000","last_change":"2024-09-10T11:52:53.173470+0000","last_active":"2024-09-10T11:52:53.173470+0000","last_peered":"2024-09-10T11:52:53.173470+0000","last_clean":"2024-09-10T11:52:53.173470+0000","last_became_active":"2024-09-10T11:47:27.751670+0000","last_became_peered":"2024-09-10T11:47:27.751670+0000","last_unstale":"2024-09-10T11:52:53.173470+0000","last_undegraded":"2024-09-10T11:52:53.173470+0000","last_fullsized":"2024-09-10T11:52:53.173470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.173257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.173257+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.173257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:17.644845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.105378+0000","last_change":"2024-09-10T11:52:44.105378+0000","last_active":"2024-09-10T11:52:44.105378+0000","last_peered":"2024-09-10T11:52:44.105378+0000","last_clean":"2024-09-10T11:52:44.105378+0000","last_became_active":"2024-09-10T11:47:26.756976+0000","last_became_peered":"2024-09-10T11:47:26.756976+0000","last_unstale":"2024-09-10T11:52:44.105378+0000","last_undegraded":"2024-09-10T11:52:44.105378+0000","last_fullsized":"2024-09-10T11:52:44.105378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.105304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.105304+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.105304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:05.230320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.038443+0000","last_change":"2024-09-10T11:52:51.038443+0000","last_active":"2024-09-10T11:52:51.038443+0000","last_peered":"2024-09-10T11:52:51.038443+0000","last_clean":"2024-09-10T11:52:51.038443+0000","last_became_active":"2024-09-10T11:47:27.758417+0000","last_became_peered":"2024-09-10T11:47:27.758417+0000","last_unstale":"2024-09-10T11:52:51.038443+0000","last_undegraded":"2024-09-10T11:52:51.038443+0000","last_fullsized":"2024-09-10T11:52:51.038443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.038254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.038254+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.038254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:36.821445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.290233+0000","last_change":"2024-09-10T11:52:49.290233+0000","last_active":"2024-09-10T11:52:49.290233+0000","last_peered":"2024-09-10T11:52:49.290233+0000","last_clean":"2024-09-10T11:52:49.290233+0000","last_became_active":"2024-09-10T11:47:26.745553+0000","last_became_peered":"2024-09-10T11:47:26.745553+0000","last_unstale":"2024-09-10T11:52:49.290233+0000","last_undegraded":"2024-09-10T11:52:49.290233+0000","last_fullsized":"2024-09-10T11:52:49.290233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.290063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.290063+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.290063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:22.366284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.637926+0000","last_change":"2024-09-10T11:52:49.637926+0000","last_active":"2024-09-10T11:52:49.637926+0000","last_peered":"2024-09-10T11:52:49.637926+0000","last_clean":"2024-09-10T11:52:49.637926+0000","last_became_active":"2024-09-10T11:47:27.747236+0000","last_became_peered":"2024-09-10T11:47:27.747236+0000","last_unstale":"2024-09-10T11:52:49.637926+0000","last_undegraded":"2024-09-10T11:52:49.637926+0000","last_fullsized":"2024-09-10T11:52:49.637926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.637740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.637740+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.637740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:03.563714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.179422+0000","last_change":"2024-09-10T11:52:47.179422+0000","last_active":"2024-09-10T11:52:47.179422+0000","last_peered":"2024-09-10T11:52:47.179422+0000","last_clean":"2024-09-10T11:52:47.179422+0000","last_became_active":"2024-09-10T11:47:26.758805+0000","last_became_peered":"2024-09-10T11:47:26.758805+0000","last_unstale":"2024-09-10T11:52:47.179422+0000","last_undegraded":"2024-09-10T11:52:47.179422+0000","last_fullsized":"2024-09-10T11:52:47.179422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-09-10T11:52:47.179205+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-09-10T11:52:47.179205+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.179205+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:46.601865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:58.726626+0000","last_change":"2024-09-10T11:52:58.726626+0000","last_active":"2024-09-10T11:52:58.726626+0000","last_peered":"2024-09-10T11:52:58.726626+0000","last_clean":"2024-09-10T11:52:58.726626+0000","last_became_active":"2024-09-10T11:47:27.768842+0000","last_became_peered":"2024-09-10T11:47:27.768842+0000","last_unstale":"2024-09-10T11:52:58.726626+0000","last_undegraded":"2024-09-10T11:52:58.726626+0000","last_fullsized":"2024-09-10T11:52:58.726626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:58.726453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:58.726453+0000","last_clean_scrub_stamp":"2024-09-10T11:52:58.726453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:47.608479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.074662+0000","last_change":"2024-09-10T11:52:46.074662+0000","last_active":"2024-09-10T11:52:46.074662+0000","last_peered":"2024-09-10T11:52:46.074662+0000","last_clean":"2024-09-10T11:52:46.074662+0000","last_became_active":"2024-09-10T11:47:26.759025+0000","last_became_peered":"2024-09-10T11:47:26.759025+0000","last_unstale":"2024-09-10T11:52:46.074662+0000","last_undegraded":"2024-09-10T11:52:46.074662+0000","last_fullsized":"2024-09-10T11:52:46.074662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-09-10T11:52:46.074476+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-09-10T11:52:46.074476+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.074476+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:42.141975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.340776+0000","last_change":"2024-09-10T11:52:52.340776+0000","last_active":"2024-09-10T11:52:52.340776+0000","last_peered":"2024-09-10T11:52:52.340776+0000","last_clean":"2024-09-10T11:52:52.340776+0000","last_became_active":"2024-09-10T11:47:27.775130+0000","last_became_peered":"2024-09-10T11:47:27.775130+0000","last_unstale":"2024-09-10T11:52:52.340776+0000","last_undegraded":"2024-09-10T11:52:52.340776+0000","last_fullsized":"2024-09-10T11:52:52.340776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.340585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.340585+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.340585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:13.089800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.130047+0000","last_change":"2024-09-10T11:52:46.130047+0000","last_active":"2024-09-10T11:52:46.130047+0000","last_peered":"2024-09-10T11:52:46.130047+0000","last_clean":"2024-09-10T11:52:46.130047+0000","last_became_active":"2024-09-10T11:47:26.751867+0000","last_became_peered":"2024-09-10T11:47:26.751867+0000","last_unstale":"2024-09-10T11:52:46.130047+0000","last_undegraded":"2024-09-10T11:52:46.130047+0000","last_fullsized":"2024-09-10T11:52:46.130047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-09-10T11:52:46.129879+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-09-10T11:52:46.129879+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.129879+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:48.903739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.917623+0000","last_change":"2024-09-10T11:52:49.917623+0000","last_active":"2024-09-10T11:52:49.917623+0000","last_peered":"2024-09-10T11:52:49.917623+0000","last_clean":"2024-09-10T11:52:49.917623+0000","last_became_active":"2024-09-10T11:47:27.765871+0000","last_became_peered":"2024-09-10T11:47:27.765871+0000","last_unstale":"2024-09-10T11:52:49.917623+0000","last_undegraded":"2024-09-10T11:52:49.917623+0000","last_fullsized":"2024-09-10T11:52:49.917623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.917431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.917431+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.917431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:04.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.562182+0000","last_change":"2024-09-10T11:52:51.562182+0000","last_active":"2024-09-10T11:52:51.562182+0000","last_peered":"2024-09-10T11:52:51.562182+0000","last_clean":"2024-09-10T11:52:51.562182+0000","last_became_active":"2024-09-10T11:47:26.748614+0000","last_became_peered":"2024-09-10T11:47:26.748614+0000","last_unstale":"2024-09-10T11:52:51.562182+0000","last_undegraded":"2024-09-10T11:52:51.562182+0000","last_fullsized":"2024-09-10T11:52:51.562182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.561990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.561990+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.561990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:43.185142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:57.676610+0000","last_change":"2024-09-10T11:52:57.676610+0000","last_active":"2024-09-10T11:52:57.676610+0000","last_peered":"2024-09-10T11:52:57.676610+0000","last_clean":"2024-09-10T11:52:57.676610+0000","last_became_active":"2024-09-10T11:47:27.776563+0000","last_became_peered":"2024-09-10T11:47:27.776563+0000","last_unstale":"2024-09-10T11:52:57.676610+0000","last_undegraded":"2024-09-10T11:52:57.676610+0000","last_fullsized":"2024-09-10T11:52:57.676610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:57.676432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:57.676432+0000","last_clean_scrub_stamp":"2024-09-10T11:52:57.676432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.482236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.262931+0000","last_change":"2024-09-10T11:52:44.262931+0000","last_active":"2024-09-10T11:52:44.262931+0000","last_peered":"2024-09-10T11:52:44.262931+0000","last_clean":"2024-09-10T11:52:44.262931+0000","last_became_active":"2024-09-10T11:47:26.751082+0000","last_became_peered":"2024-09-10T11:47:26.751082+0000","last_unstale":"2024-09-10T11:52:44.262931+0000","last_undegraded":"2024-09-10T11:52:44.262931+0000","last_fullsized":"2024-09-10T11:52:44.262931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.262838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.262838+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.262838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.167749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.102689+0000","last_change":"2024-09-10T11:52:45.102689+0000","last_active":"2024-09-10T11:52:45.102689+0000","last_peered":"2024-09-10T11:52:45.102689+0000","last_clean":"2024-09-10T11:52:45.102689+0000","last_became_active":"2024-09-10T11:47:27.758682+0000","last_became_peered":"2024-09-10T11:47:27.758682+0000","last_unstale":"2024-09-10T11:52:45.102689+0000","last_undegraded":"2024-09-10T11:52:45.102689+0000","last_fullsized":"2024-09-10T11:52:45.102689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.102572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.102572+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.102572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:15.259759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'12","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.081926+0000","last_change":"2024-09-10T11:52:48.081926+0000","last_active":"2024-09-10T11:52:48.081926+0000","last_peered":"2024-09-10T11:52:48.081926+0000","last_clean":"2024-09-10T11:52:48.081926+0000","last_became_active":"2024-09-10T11:47:26.758810+0000","last_became_peered":"2024-09-10T11:47:26.758810+0000","last_unstale":"2024-09-10T11:52:48.081926+0000","last_undegraded":"2024-09-10T11:52:48.081926+0000","last_fullsized":"2024-09-10T11:52:48.081926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'12","last_scrub_stamp":"2024-09-10T11:52:48.081688+0000","last_deep_scrub":"25'12","last_deep_scrub_stamp":"2024-09-10T11:52:48.081688+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.081688+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:14:45.264719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.677668+0000","last_change":"2024-09-10T11:52:55.677668+0000","last_active":"2024-09-10T11:52:55.677668+0000","last_peered":"2024-09-10T11:52:55.677668+0000","last_clean":"2024-09-10T11:52:55.677668+0000","last_became_active":"2024-09-10T11:47:27.766095+0000","last_became_peered":"2024-09-10T11:47:27.766095+0000","last_unstale":"2024-09-10T11:52:55.677668+0000","last_undegraded":"2024-09-10T11:52:55.677668+0000","last_fullsized":"2024-09-10T11:52:55.677668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.677395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.677395+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.677395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:04.445725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.268326+0000","last_change":"2024-09-10T11:52:45.268326+0000","last_active":"2024-09-10T11:52:45.268326+0000","last_peered":"2024-09-10T11:52:45.268326+0000","last_clean":"2024-09-10T11:52:45.268326+0000","last_became_active":"2024-09-10T11:47:26.767191+0000","last_became_peered":"2024-09-10T11:47:26.767191+0000","last_unstale":"2024-09-10T11:52:45.268326+0000","last_undegraded":"2024-09-10T11:52:45.268326+0000","last_fullsized":"2024-09-10T11:52:45.268326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-10T11:52:45.268216+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-10T11:52:45.268216+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.268216+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:59.194190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.087926+0000","last_change":"2024-09-10T11:52:45.087926+0000","last_active":"2024-09-10T11:52:45.087926+0000","last_peered":"2024-09-10T11:52:45.087926+0000","last_clean":"2024-09-10T11:52:45.087926+0000","last_became_active":"2024-09-10T11:47:27.764562+0000","last_became_peered":"2024-09-10T11:47:27.764562+0000","last_unstale":"2024-09-10T11:52:45.087926+0000","last_undegraded":"2024-09-10T11:52:45.087926+0000","last_fullsized":"2024-09-10T11:52:45.087926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.087742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.087742+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.087742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:38.517577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.119569+0000","last_change":"2024-09-10T11:52:46.119569+0000","last_active":"2024-09-10T11:52:46.119569+0000","last_peered":"2024-09-10T11:52:46.119569+0000","last_clean":"2024-09-10T11:52:46.119569+0000","last_became_active":"2024-09-10T11:47:26.768788+0000","last_became_peered":"2024-09-10T11:47:26.768788+0000","last_unstale":"2024-09-10T11:52:46.119569+0000","last_undegraded":"2024-09-10T11:52:46.119569+0000","last_fullsized":"2024-09-10T11:52:46.119569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:46.119346+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:46.119346+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.119346+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:25.019746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.333648+0000","last_change":"2024-09-10T11:52:50.333648+0000","last_active":"2024-09-10T11:52:50.333648+0000","last_peered":"2024-09-10T11:52:50.333648+0000","last_clean":"2024-09-10T11:52:50.333648+0000","last_became_active":"2024-09-10T11:47:27.772268+0000","last_became_peered":"2024-09-10T11:47:27.772268+0000","last_unstale":"2024-09-10T11:52:50.333648+0000","last_undegraded":"2024-09-10T11:52:50.333648+0000","last_fullsized":"2024-09-10T11:52:50.333648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.333469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.333469+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.333469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:32.863697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'2","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.593670+0000","last_change":"2024-09-10T11:52:50.593670+0000","last_active":"2024-09-10T11:52:50.593670+0000","last_peered":"2024-09-10T11:52:50.593670+0000","last_clean":"2024-09-10T11:52:50.593670+0000","last_became_active":"2024-09-10T11:47:26.749367+0000","last_became_peered":"2024-09-10T11:47:26.749367+0000","last_unstale":"2024-09-10T11:52:50.593670+0000","last_undegraded":"2024-09-10T11:52:50.593670+0000","last_fullsized":"2024-09-10T11:52:50.593670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-10T11:52:50.593483+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-10T11:52:50.593483+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.593483+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:08.443034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.323522+0000","last_change":"2024-09-10T11:52:51.323522+0000","last_active":"2024-09-10T11:52:51.323522+0000","last_peered":"2024-09-10T11:52:51.323522+0000","last_clean":"2024-09-10T11:52:51.323522+0000","last_became_active":"2024-09-10T11:47:27.775945+0000","last_became_peered":"2024-09-10T11:47:27.775945+0000","last_unstale":"2024-09-10T11:52:51.323522+0000","last_undegraded":"2024-09-10T11:52:51.323522+0000","last_fullsized":"2024-09-10T11:52:51.323522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.323319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.323319+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.323319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:38.374324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.939184+0000","last_change":"2024-09-10T11:52:47.939184+0000","last_active":"2024-09-10T11:52:47.939184+0000","last_peered":"2024-09-10T11:52:47.939184+0000","last_clean":"2024-09-10T11:52:47.939184+0000","last_became_active":"2024-09-10T11:47:26.753115+0000","last_became_peered":"2024-09-10T11:47:26.753115+0000","last_unstale":"2024-09-10T11:52:47.939184+0000","last_undegraded":"2024-09-10T11:52:47.939184+0000","last_fullsized":"2024-09-10T11:52:47.939184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.939001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.939001+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.939001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:30.051075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:53.653277+0000","last_change":"2024-09-10T11:52:53.653277+0000","last_active":"2024-09-10T11:52:53.653277+0000","last_peered":"2024-09-10T11:52:53.653277+0000","last_clean":"2024-09-10T11:52:53.653277+0000","last_became_active":"2024-09-10T11:47:27.765941+0000","last_became_peered":"2024-09-10T11:47:27.765941+0000","last_unstale":"2024-09-10T11:52:53.653277+0000","last_undegraded":"2024-09-10T11:52:53.653277+0000","last_fullsized":"2024-09-10T11:52:53.653277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:53.653071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:53.653071+0000","last_clean_scrub_stamp":"2024-09-10T11:52:53.653071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:03.197575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'74","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:43.087571+0000","last_change":"2024-09-10T11:52:43.087481+0000","last_active":"2024-09-10T11:52:43.087571+0000","last_peered":"2024-09-10T11:52:43.087571+0000","last_clean":"2024-09-10T11:52:43.087571+0000","last_became_active":"2024-09-10T11:47:19.225385+0000","last_became_peered":"2024-09-10T11:47:19.225385+0000","last_unstale":"2024-09-10T11:52:43.087571+0000","last_undegraded":"2024-09-10T11:52:43.087571+0000","last_fullsized":"2024-09-10T11:52:43.087571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-09-10T11:52:43.087397+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-09-10T11:52:43.087397+0000","last_clean_scrub_stamp":"2024-09-10T11:52:43.087397+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:22.812999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.624034+0000","last_change":"2024-09-10T11:52:45.624034+0000","last_active":"2024-09-10T11:52:45.624034+0000","last_peered":"2024-09-10T11:52:45.624034+0000","last_clean":"2024-09-10T11:52:45.624034+0000","last_became_active":"2024-09-10T11:47:26.737065+0000","last_became_peered":"2024-09-10T11:47:26.737065+0000","last_unstale":"2024-09-10T11:52:45.624034+0000","last_undegraded":"2024-09-10T11:52:45.624034+0000","last_fullsized":"2024-09-10T11:52:45.624034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.623844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.623844+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.623844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:24.927092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.104327+0000","last_change":"2024-09-10T11:52:51.104327+0000","last_active":"2024-09-10T11:52:51.104327+0000","last_peered":"2024-09-10T11:52:51.104327+0000","last_clean":"2024-09-10T11:52:51.104327+0000","last_became_active":"2024-09-10T11:47:27.748477+0000","last_became_peered":"2024-09-10T11:47:27.748477+0000","last_unstale":"2024-09-10T11:52:51.104327+0000","last_undegraded":"2024-09-10T11:52:51.104327+0000","last_fullsized":"2024-09-10T11:52:51.104327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.104229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.104229+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.104229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:25.978709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.639254+0000","last_change":"2024-09-10T11:52:44.639254+0000","last_active":"2024-09-10T11:52:44.639254+0000","last_peered":"2024-09-10T11:52:44.639254+0000","last_clean":"2024-09-10T11:52:44.639254+0000","last_became_active":"2024-09-10T11:47:26.767086+0000","last_became_peered":"2024-09-10T11:47:26.767086+0000","last_unstale":"2024-09-10T11:52:44.639254+0000","last_undegraded":"2024-09-10T11:52:44.639254+0000","last_fullsized":"2024-09-10T11:52:44.639254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.639055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.639055+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.639055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:25.618013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.936246+0000","last_change":"2024-09-10T11:52:48.936246+0000","last_active":"2024-09-10T11:52:48.936246+0000","last_peered":"2024-09-10T11:52:48.936246+0000","last_clean":"2024-09-10T11:52:48.936246+0000","last_became_active":"2024-09-10T11:47:27.770522+0000","last_became_peered":"2024-09-10T11:47:27.770522+0000","last_unstale":"2024-09-10T11:52:48.936246+0000","last_undegraded":"2024-09-10T11:52:48.936246+0000","last_fullsized":"2024-09-10T11:52:48.936246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.936063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.936063+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.936063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:11.991693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:51.193565+0000","last_change":"2024-09-10T11:52:51.193565+0000","last_active":"2024-09-10T11:52:51.193565+0000","last_peered":"2024-09-10T11:52:51.193565+0000","last_clean":"2024-09-10T11:52:51.193565+0000","last_became_active":"2024-09-10T11:47:26.763940+0000","last_became_peered":"2024-09-10T11:47:26.763940+0000","last_unstale":"2024-09-10T11:52:51.193565+0000","last_undegraded":"2024-09-10T11:52:51.193565+0000","last_fullsized":"2024-09-10T11:52:51.193565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:51.193438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:51.193438+0000","last_clean_scrub_stamp":"2024-09-10T11:52:51.193438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:16.633300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.656645+0000","last_change":"2024-09-10T11:52:48.656645+0000","last_active":"2024-09-10T11:52:48.656645+0000","last_peered":"2024-09-10T11:52:48.656645+0000","last_clean":"2024-09-10T11:52:48.656645+0000","last_became_active":"2024-09-10T11:47:27.760164+0000","last_became_peered":"2024-09-10T11:47:27.760164+0000","last_unstale":"2024-09-10T11:52:48.656645+0000","last_undegraded":"2024-09-10T11:52:48.656645+0000","last_fullsized":"2024-09-10T11:52:48.656645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.656433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.656433+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.656433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:47.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.635032+0000","last_change":"2024-09-10T11:52:46.635032+0000","last_active":"2024-09-10T11:52:46.635032+0000","last_peered":"2024-09-10T11:52:46.635032+0000","last_clean":"2024-09-10T11:52:46.635032+0000","last_became_active":"2024-09-10T11:47:26.743963+0000","last_became_peered":"2024-09-10T11:47:26.743963+0000","last_unstale":"2024-09-10T11:52:46.635032+0000","last_undegraded":"2024-09-10T11:52:46.635032+0000","last_fullsized":"2024-09-10T11:52:46.635032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.634846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.634846+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.634846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:29.165075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.250829+0000","last_change":"2024-09-10T11:52:46.250829+0000","last_active":"2024-09-10T11:52:46.250829+0000","last_peered":"2024-09-10T11:52:46.250829+0000","last_clean":"2024-09-10T11:52:46.250829+0000","last_became_active":"2024-09-10T11:47:27.771354+0000","last_became_peered":"2024-09-10T11:47:27.771354+0000","last_unstale":"2024-09-10T11:52:46.250829+0000","last_undegraded":"2024-09-10T11:52:46.250829+0000","last_fullsized":"2024-09-10T11:52:46.250829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.250640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.250640+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.250640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.100191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:46.659600+0000","last_change":"2024-09-10T11:52:46.659600+0000","last_active":"2024-09-10T11:52:46.659600+0000","last_peered":"2024-09-10T11:52:46.659600+0000","last_clean":"2024-09-10T11:52:46.659600+0000","last_became_active":"2024-09-10T11:47:26.756268+0000","last_became_peered":"2024-09-10T11:47:26.756268+0000","last_unstale":"2024-09-10T11:52:46.659600+0000","last_undegraded":"2024-09-10T11:52:46.659600+0000","last_fullsized":"2024-09-10T11:52:46.659600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:46.659386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:46.659386+0000","last_clean_scrub_stamp":"2024-09-10T11:52:46.659386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:18.172574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:44.055071+0000","last_change":"2024-09-10T11:52:44.055071+0000","last_active":"2024-09-10T11:52:44.055071+0000","last_peered":"2024-09-10T11:52:44.055071+0000","last_clean":"2024-09-10T11:52:44.055071+0000","last_became_active":"2024-09-10T11:47:27.758599+0000","last_became_peered":"2024-09-10T11:47:27.758599+0000","last_unstale":"2024-09-10T11:52:44.055071+0000","last_undegraded":"2024-09-10T11:52:44.055071+0000","last_fullsized":"2024-09-10T11:52:44.055071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:44.054886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:44.054886+0000","last_clean_scrub_stamp":"2024-09-10T11:52:44.054886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:05.179902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.602673+0000","last_change":"2024-09-10T11:52:47.602673+0000","last_active":"2024-09-10T11:52:47.602673+0000","last_peered":"2024-09-10T11:52:47.602673+0000","last_clean":"2024-09-10T11:52:47.602673+0000","last_became_active":"2024-09-10T11:47:26.748829+0000","last_became_peered":"2024-09-10T11:47:26.748829+0000","last_unstale":"2024-09-10T11:52:47.602673+0000","last_undegraded":"2024-09-10T11:52:47.602673+0000","last_fullsized":"2024-09-10T11:52:47.602673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.602483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.602483+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.602483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:36.251078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.878024+0000","last_change":"2024-09-10T11:52:50.878024+0000","last_active":"2024-09-10T11:52:50.878024+0000","last_peered":"2024-09-10T11:52:50.878024+0000","last_clean":"2024-09-10T11:52:50.878024+0000","last_became_active":"2024-09-10T11:47:27.783871+0000","last_became_peered":"2024-09-10T11:47:27.783871+0000","last_unstale":"2024-09-10T11:52:50.878024+0000","last_undegraded":"2024-09-10T11:52:50.878024+0000","last_fullsized":"2024-09-10T11:52:50.878024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:50.877850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:50.877850+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.877850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:17.856010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'2","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.154825+0000","last_change":"2024-09-10T11:52:45.154825+0000","last_active":"2024-09-10T11:52:45.154825+0000","last_peered":"2024-09-10T11:52:45.154825+0000","last_clean":"2024-09-10T11:52:45.154825+0000","last_became_active":"2024-09-10T11:47:26.760212+0000","last_became_peered":"2024-09-10T11:47:26.760212+0000","last_unstale":"2024-09-10T11:52:45.154825+0000","last_undegraded":"2024-09-10T11:52:45.154825+0000","last_fullsized":"2024-09-10T11:52:45.154825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-10T11:52:45.154550+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-10T11:52:45.154550+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.154550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:46.511320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:54.201792+0000","last_change":"2024-09-10T11:52:54.201792+0000","last_active":"2024-09-10T11:52:54.201792+0000","last_peered":"2024-09-10T11:52:54.201792+0000","last_clean":"2024-09-10T11:52:54.201792+0000","last_became_active":"2024-09-10T11:47:27.785199+0000","last_became_peered":"2024-09-10T11:47:27.785199+0000","last_unstale":"2024-09-10T11:52:54.201792+0000","last_undegraded":"2024-09-10T11:52:54.201792+0000","last_fullsized":"2024-09-10T11:52:54.201792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:54.201609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:54.201609+0000","last_clean_scrub_stamp":"2024-09-10T11:52:54.201609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:43.630940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.638119+0000","last_change":"2024-09-10T11:52:48.638119+0000","last_active":"2024-09-10T11:52:48.638119+0000","last_peered":"2024-09-10T11:52:48.638119+0000","last_clean":"2024-09-10T11:52:48.638119+0000","last_became_active":"2024-09-10T11:47:26.750521+0000","last_became_peered":"2024-09-10T11:47:26.750521+0000","last_unstale":"2024-09-10T11:52:48.638119+0000","last_undegraded":"2024-09-10T11:52:48.638119+0000","last_fullsized":"2024-09-10T11:52:48.638119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:48.637924+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:48.637924+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.637924+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:09.053983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.055184+0000","last_change":"2024-09-10T11:52:49.055184+0000","last_active":"2024-09-10T11:52:49.055184+0000","last_peered":"2024-09-10T11:52:49.055184+0000","last_clean":"2024-09-10T11:52:49.055184+0000","last_became_active":"2024-09-10T11:47:27.767475+0000","last_became_peered":"2024-09-10T11:47:27.767475+0000","last_unstale":"2024-09-10T11:52:49.055184+0000","last_undegraded":"2024-09-10T11:52:49.055184+0000","last_fullsized":"2024-09-10T11:52:49.055184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:49.055012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:49.055012+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.055012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:53.575788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:43.296628+0000","last_change":"2024-09-10T11:52:43.296628+0000","last_active":"2024-09-10T11:52:43.296628+0000","last_peered":"2024-09-10T11:52:43.296628+0000","last_clean":"2024-09-10T11:52:43.296628+0000","last_became_active":"2024-09-10T11:47:26.748585+0000","last_became_peered":"2024-09-10T11:47:26.748585+0000","last_unstale":"2024-09-10T11:52:43.296628+0000","last_undegraded":"2024-09-10T11:52:43.296628+0000","last_fullsized":"2024-09-10T11:52:43.296628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:43.296454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:43.296454+0000","last_clean_scrub_stamp":"2024-09-10T11:52:43.296454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:10.877120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.606719+0000","last_change":"2024-09-10T11:52:52.606719+0000","last_active":"2024-09-10T11:52:52.606719+0000","last_peered":"2024-09-10T11:52:52.606719+0000","last_clean":"2024-09-10T11:52:52.606719+0000","last_became_active":"2024-09-10T11:47:27.763277+0000","last_became_peered":"2024-09-10T11:47:27.763277+0000","last_unstale":"2024-09-10T11:52:52.606719+0000","last_undegraded":"2024-09-10T11:52:52.606719+0000","last_fullsized":"2024-09-10T11:52:52.606719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.606497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.606497+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.606497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:33.658980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.110703+0000","last_change":"2024-09-10T11:52:47.110703+0000","last_active":"2024-09-10T11:52:47.110703+0000","last_peered":"2024-09-10T11:52:47.110703+0000","last_clean":"2024-09-10T11:52:47.110703+0000","last_became_active":"2024-09-10T11:47:26.761749+0000","last_became_peered":"2024-09-10T11:47:26.761749+0000","last_unstale":"2024-09-10T11:52:47.110703+0000","last_undegraded":"2024-09-10T11:52:47.110703+0000","last_fullsized":"2024-09-10T11:52:47.110703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:47.110500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:47.110500+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.110500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:07.698546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.148823+0000","last_change":"2024-09-10T11:52:52.148823+0000","last_active":"2024-09-10T11:52:52.148823+0000","last_peered":"2024-09-10T11:52:52.148823+0000","last_clean":"2024-09-10T11:52:52.148823+0000","last_became_active":"2024-09-10T11:47:27.748071+0000","last_became_peered":"2024-09-10T11:47:27.748071+0000","last_unstale":"2024-09-10T11:52:52.148823+0000","last_undegraded":"2024-09-10T11:52:52.148823+0000","last_fullsized":"2024-09-10T11:52:52.148823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.148644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.148644+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.148644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:53.504644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:45.915073+0000","last_change":"2024-09-10T11:52:45.915073+0000","last_active":"2024-09-10T11:52:45.915073+0000","last_peered":"2024-09-10T11:52:45.915073+0000","last_clean":"2024-09-10T11:52:45.915073+0000","last_became_active":"2024-09-10T11:47:26.768553+0000","last_became_peered":"2024-09-10T11:47:26.768553+0000","last_unstale":"2024-09-10T11:52:45.915073+0000","last_undegraded":"2024-09-10T11:52:45.915073+0000","last_fullsized":"2024-09-10T11:52:45.915073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:45.914888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:45.914888+0000","last_clean_scrub_stamp":"2024-09-10T11:52:45.914888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:06.409032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.209594+0000","last_change":"2024-09-10T11:52:48.209594+0000","last_active":"2024-09-10T11:52:48.209594+0000","last_peered":"2024-09-10T11:52:48.209594+0000","last_clean":"2024-09-10T11:52:48.209594+0000","last_became_active":"2024-09-10T11:47:27.786548+0000","last_became_peered":"2024-09-10T11:47:27.786548+0000","last_unstale":"2024-09-10T11:52:48.209594+0000","last_undegraded":"2024-09-10T11:52:48.209594+0000","last_fullsized":"2024-09-10T11:52:48.209594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.209369+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:39.992181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:49.599828+0000","last_change":"2024-09-10T11:52:49.599828+0000","last_active":"2024-09-10T11:52:49.599828+0000","last_peered":"2024-09-10T11:52:49.599828+0000","last_clean":"2024-09-10T11:52:49.599828+0000","last_became_active":"2024-09-10T11:47:26.738690+0000","last_became_peered":"2024-09-10T11:47:26.738690+0000","last_unstale":"2024-09-10T11:52:49.599828+0000","last_undegraded":"2024-09-10T11:52:49.599828+0000","last_fullsized":"2024-09-10T11:52:49.599828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:49.599643+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:49.599643+0000","last_clean_scrub_stamp":"2024-09-10T11:52:49.599643+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:54:29.613821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:56.693121+0000","last_change":"2024-09-10T11:52:56.693121+0000","last_active":"2024-09-10T11:52:56.693121+0000","last_peered":"2024-09-10T11:52:56.693121+0000","last_clean":"2024-09-10T11:52:56.693121+0000","last_became_active":"2024-09-10T11:47:27.766274+0000","last_became_peered":"2024-09-10T11:47:27.766274+0000","last_unstale":"2024-09-10T11:52:56.693121+0000","last_undegraded":"2024-09-10T11:52:56.693121+0000","last_fullsized":"2024-09-10T11:52:56.693121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:56.692853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:56.692853+0000","last_clean_scrub_stamp":"2024-09-10T11:52:56.692853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:53.634694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:59.764696+0000","last_change":"2024-09-10T11:52:59.764696+0000","last_active":"2024-09-10T11:52:59.764696+0000","last_peered":"2024-09-10T11:52:59.764696+0000","last_clean":"2024-09-10T11:52:59.764696+0000","last_became_active":"2024-09-10T11:47:27.759153+0000","last_became_peered":"2024-09-10T11:47:27.759153+0000","last_unstale":"2024-09-10T11:52:59.764696+0000","last_undegraded":"2024-09-10T11:52:59.764696+0000","last_fullsized":"2024-09-10T11:52:59.764696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:59.764506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:59.764506+0000","last_clean_scrub_stamp":"2024-09-10T11:52:59.764506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:30.769139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.297092+0000","last_change":"2024-09-10T11:52:48.297092+0000","last_active":"2024-09-10T11:52:48.297092+0000","last_peered":"2024-09-10T11:52:48.297092+0000","last_clean":"2024-09-10T11:52:48.297092+0000","last_became_active":"2024-09-10T11:47:26.745458+0000","last_became_peered":"2024-09-10T11:47:26.745458+0000","last_unstale":"2024-09-10T11:52:48.297092+0000","last_undegraded":"2024-09-10T11:52:48.297092+0000","last_fullsized":"2024-09-10T11:52:48.297092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:48.296855+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:48.296855+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.296855+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:05.017989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:48.160436+0000","last_change":"2024-09-10T11:52:48.160436+0000","last_active":"2024-09-10T11:52:48.160436+0000","last_peered":"2024-09-10T11:52:48.160436+0000","last_clean":"2024-09-10T11:52:48.160436+0000","last_became_active":"2024-09-10T11:47:27.759733+0000","last_became_peered":"2024-09-10T11:47:27.759733+0000","last_unstale":"2024-09-10T11:52:48.160436+0000","last_undegraded":"2024-09-10T11:52:48.160436+0000","last_fullsized":"2024-09-10T11:52:48.160436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:48.160257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:48.160257+0000","last_clean_scrub_stamp":"2024-09-10T11:52:48.160257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:01.860050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'3","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.299881+0000","last_change":"2024-09-10T11:52:47.299881+0000","last_active":"2024-09-10T11:52:47.299881+0000","last_peered":"2024-09-10T11:52:47.299881+0000","last_clean":"2024-09-10T11:52:47.299881+0000","last_became_active":"2024-09-10T11:47:26.748615+0000","last_became_peered":"2024-09-10T11:47:26.748615+0000","last_unstale":"2024-09-10T11:52:47.299881+0000","last_undegraded":"2024-09-10T11:52:47.299881+0000","last_fullsized":"2024-09-10T11:52:47.299881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-10T11:52:47.299661+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-10T11:52:47.299661+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.299661+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:47.702508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:55.685415+0000","last_change":"2024-09-10T11:52:55.685415+0000","last_active":"2024-09-10T11:52:55.685415+0000","last_peered":"2024-09-10T11:52:55.685415+0000","last_clean":"2024-09-10T11:52:55.685415+0000","last_became_active":"2024-09-10T11:47:27.765274+0000","last_became_peered":"2024-09-10T11:47:27.765274+0000","last_unstale":"2024-09-10T11:52:55.685415+0000","last_undegraded":"2024-09-10T11:52:55.685415+0000","last_fullsized":"2024-09-10T11:52:55.685415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:55.685226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:55.685226+0000","last_clean_scrub_stamp":"2024-09-10T11:52:55.685226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:16.101285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:47.649853+0000","last_change":"2024-09-10T11:52:47.649853+0000","last_active":"2024-09-10T11:52:47.649853+0000","last_peered":"2024-09-10T11:52:47.649853+0000","last_clean":"2024-09-10T11:52:47.649853+0000","last_became_active":"2024-09-10T11:47:26.752115+0000","last_became_peered":"2024-09-10T11:47:26.752115+0000","last_unstale":"2024-09-10T11:52:47.649853+0000","last_undegraded":"2024-09-10T11:52:47.649853+0000","last_fullsized":"2024-09-10T11:52:47.649853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-09-10T11:52:47.649650+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-09-10T11:52:47.649650+0000","last_clean_scrub_stamp":"2024-09-10T11:52:47.649650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:21.114700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:52.657025+0000","last_change":"2024-09-10T11:52:52.657025+0000","last_active":"2024-09-10T11:52:52.657025+0000","last_peered":"2024-09-10T11:52:52.657025+0000","last_clean":"2024-09-10T11:52:52.657025+0000","last_became_active":"2024-09-10T11:47:27.767854+0000","last_became_peered":"2024-09-10T11:47:27.767854+0000","last_unstale":"2024-09-10T11:52:52.657025+0000","last_undegraded":"2024-09-10T11:52:52.657025+0000","last_fullsized":"2024-09-10T11:52:52.657025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:52:52.656807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:52:52.656807+0000","last_clean_scrub_stamp":"2024-09-10T11:52:52.656807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'6","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T11:52:50.097915+0000","last_change":"2024-09-10T11:52:50.097915+0000","last_active":"2024-09-10T11:52:50.097915+0000","last_peered":"2024-09-10T11:52:50.097915+0000","last_clean":"2024-09-10T11:52:50.097915+0000","last_became_active":"2024-09-10T11:47:26.760467+0000","last_became_peered":"2024-09-10T11:47:26.760467+0000","last_unstale":"2024-09-10T11:52:50.097915+0000","last_undegraded":"2024-09-10T11:52:50.097915+0000","last_fullsized":"2024-09-10T11:52:50.097915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-09-10T11:52:50.097725+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-09-10T11:52:50.097725+0000","last_clean_scrub_stamp":"2024-09-10T11:52:50.097725+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:22.198325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509518,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":93272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":683608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":95432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":94760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":258048,"data_stored":93148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:53:26.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T11:53:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 -- 172.21.15.78:0/3971833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 msgr2=0x7f8e88072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 --2- 172.21.15.78:0/3971833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 0x7f8e88072680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009bc0 tx=0x7f8e8001cb10 comp rx=0 tx=0).stop 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 -- 172.21.15.78:0/3971833583 shutdown_connections 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 --2- 172.21.15.78:0/3971833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 0x7f8e88072680 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 --2- 172.21.15.78:0/3971833583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e88140450 0x7f8e880b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 -- 172.21.15.78:0/3971833583 >> 172.21.15.78:0/3971833583 conn(0x7f8e880b1970 msgr2=0x7f8e880b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 -- 172.21.15.78:0/3971833583 shutdown_connections 2024-09-10T11:53:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 -- 172.21.15.78:0/3971833583 wait complete. 2024-09-10T11:53:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 Processor -- start 2024-09-10T11:53:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.666+0000 7f8e9068f640 1 -- start start 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 0x7f8e88138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 0x7f8e8813a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e88140450 0x7f8e8813a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8e88073430 con 0x7f8e880b30c0 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e880732b0 con 0x7f8e8806e650 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8e880735b0 con 0x7f8e88140450 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 0x7f8e8813a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 0x7f8e8813a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56146/0 (socket says 172.21.15.78:56146) 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 -- 172.21.15.78:0/1881431268 learned_addr learned my addr 172.21.15.78:0/1881431268 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8ec2c640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e88140450 0x7f8e8813a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8e42b640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 0x7f8e88138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 -- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e88140450 msgr2=0x7f8e8813a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e88140450 0x7f8e8813a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 -- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 msgr2=0x7f8e88138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 0x7f8e88138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 -- 172.21.15.78:0/1881431268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e88140e40 con 0x7f8e880b30c0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8dc2a640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 0x7f8e8813a1d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800c460 tx=0x7f8e7800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78016020 con 0x7f8e880b30c0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e78012920 con 0x7f8e880b30c0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e88141120 con 0x7f8e880b30c0 2024-09-10T11:53:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78012d50 con 0x7f8e880b30c0 2024-09-10T11:53:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e881416e0 con 0x7f8e880b30c0 2024-09-10T11:53:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e880b34a0 con 0x7f8e880b30c0 2024-09-10T11:53:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 93821+0+0 (secure 0 0 0) 0x7f8e78019020 con 0x7f8e880b30c0 2024-09-10T11:53:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e7effd640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8e6c06f710 0x7f8e6c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:53:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8e7808f430 con 0x7f8e880b30c0 2024-09-10T11:53:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.670+0000 7f8e8e42b640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8e6c06f710 0x7f8e6c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:53:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.674+0000 7f8e8e42b640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8e6c06f710 0x7f8e6c071bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e880b14b0 tx=0x7f8e840091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:53:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.674+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+170746 (secure 0 0 0) 0x7f8e78020030 con 0x7f8e880b30c0 2024-09-10T11:53:26.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.822+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f8e880b1200 con 0x7f8e880b30c0 2024-09-10T11:53:26.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.826+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f8e7805c3e0 con 0x7f8e880b30c0 2024-09-10T11:53:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e7effd640 1 -- 172.21.15.78:0/1881431268 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f8e7805b7f0 con 0x7f8e880b30c0 2024-09-10T11:53:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8e6c06f710 msgr2=0x7f8e6c071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8e6c06f710 0x7f8e6c071bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e880b14b0 tx=0x7f8e840091e0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 msgr2=0x7f8e8813a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:53:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 0x7f8e8813a1d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800c460 tx=0x7f8e7800c920 comp rx=0 tx=0).stop 2024-09-10T11:53:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 shutdown_connections 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:6800/4127887797,v1:172.21.15.112:6801/4127887797] conn(0x7f8e6c06f710 0x7f8e6c071bd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e88140450 0x7f8e8813a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e880b30c0 0x7f8e8813a1d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 --2- 172.21.15.78:0/1881431268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e8806e650 0x7f8e88138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 >> 172.21.15.78:0/1881431268 conn(0x7f8e880b1970 msgr2=0x7f8e880b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 shutdown_connections 2024-09-10T11:53:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-10T11:53:26.830+0000 7f8e9068f640 1 -- 172.21.15.78:0/1881431268 wait complete. 2024-09-10T11:53:26.849 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1978, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-10T11:53:26.851 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T11:53:26.851 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T11:53:26.852 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:26.864 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T11:53:26.864 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T11:53:26.864 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:26.916 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T11:53:26.916 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T11:53:26.916 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:26.935 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T11:53:26.936 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T11:53:26.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:26.991 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T11:53:26.991 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T11:53:26.992 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T11:53:26.992 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:27.084 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T11:53:27.084 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T11:53:27.085 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:32.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-10T11:53:33.186 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T11:53:33.187 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T11:53:33.187 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.247 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T11:53:33.247 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T11:53:33.248 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.343 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T11:53:33.344 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T11:53:33.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.415 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T11:53:33.416 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T11:53:33.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.479 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T11:53:33.480 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T11:53:33.480 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.563 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T11:53:33.564 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T11:53:33.564 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.663 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T11:53:33.663 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T11:53:33.664 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T11:53:33.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.695 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T11:53:33.695 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T11:53:33.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.725 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T11:53:33.725 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T11:53:33.725 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T11:53:33.725 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.750 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T11:53:33.751 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T11:53:33.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.789 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T11:53:33.789 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T11:53:33.789 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:53:33.843 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T11:53:33.843 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T11:53:33.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T11:53:33.864 INFO:teuthology.orchestra.run.smithi078.stdout:2024-09-10T11:47:07.257988+0000 mgr.y (mgr.4141) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-10T11:53:33.865 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T11:53:33.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T11:53:33.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T11:53:33.983 INFO:teuthology.orchestra.run.smithi078.stdout:2024-09-10T11:47:07.257988+0000 mgr.y (mgr.4141) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-10T11:53:33.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:53:33.984 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T11:53:34.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:53:34.431 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T11:53:34.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:53:34.690 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T11:53:34.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:53:34.833 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T11:53:34.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:53:34.983 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T11:53:35.292 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:53:35.293 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T11:53:35.498 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:53:35.498 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T11:53:35.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:53:35.697 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T11:53:35.880 INFO:tasks.ceph:Archiving mon data... 2024-09-10T11:53:35.882 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/data/mon.a.tgz 2024-09-10T11:53:35.882 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-10T11:53:35.888 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.EFU1o8qYS7 2024-09-10T11:53:35.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.EFU1o8qYS7 2024-09-10T11:53:36.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.EFU1o8qYS7 2024-09-10T11:53:36.070 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.EFU1o8qYS7 is 316KB 2024-09-10T11:53:36.131 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.EFU1o8qYS7 2024-09-10T11:53:36.136 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/data/mon.b.tgz 2024-09-10T11:53:36.136 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-10T11:53:36.142 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.VEfb4Qoin3 2024-09-10T11:53:36.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VEfb4Qoin3 2024-09-10T11:53:36.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.VEfb4Qoin3 2024-09-10T11:53:36.354 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.VEfb4Qoin3 is 429KB 2024-09-10T11:53:36.416 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.VEfb4Qoin3 2024-09-10T11:53:36.422 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/data/mon.c.tgz 2024-09-10T11:53:36.422 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.SOGg7W0uCV 2024-09-10T11:53:36.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.SOGg7W0uCV 2024-09-10T11:53:36.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.SOGg7W0uCV 2024-09-10T11:53:36.678 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.SOGg7W0uCV is 428KB 2024-09-10T11:53:36.740 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.SOGg7W0uCV 2024-09-10T11:53:36.746 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T11:53:36.746 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T11:53:36.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T11:53:36.808 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T11:53:36.851 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T11:53:36.851 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T11:53:36.853 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/remote/smithi078/crash 2024-09-10T11:53:36.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T11:53:36.869 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/remote/smithi112/crash 2024-09-10T11:53:36.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T11:53:36.908 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T11:53:36.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:36.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:36.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:37.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T11:53:37.049 INFO:tasks.ceph:Compressing logs... 2024-09-10T11:53:37.050 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:53:37.052 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:53:37.077 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36023.log 2024-09-10T11:53:37.078 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35299.log 2024-09-10T11:53:37.078 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-09-10T11:53:37.079 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36023.log.gz 2024-09-10T11:53:37.079 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35299.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35299.log.gz 2024-09-10T11:53:37.079 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28892.log 2024-09-10T11:53:37.079 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35680.log 2024-09-10T11:53:37.080 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39140.log: /var/log/ceph/ceph-client.admin.28892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37436.log 2024-09-10T11:53:37.080 INFO:teuthology.orchestra.run.smithi078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28892.log.gz 2024-09-10T11:53:37.080 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-09-10T11:53:37.080 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35680.log.gz 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37515.log 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36937.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37436.log.gz 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37515.log.gz 2024-09-10T11:53:37.082 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35498.log 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35247.log 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35498.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36304.log 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35498.log.gz 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35247.log.gz 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36516.log 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36304.log.gz 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38436.log 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-09-10T11:53:37.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36516.log.gz 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38436.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38436.log.gz 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38095.log 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37725.log 2024-09-10T11:53:37.087 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38095.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-09-10T11:53:37.091 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38173.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38095.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36035.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38173.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37725.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38932.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38173.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36595.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36035.log: /var/log/ceph/ceph-client.admin.38932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36623.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36035.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38932.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36595.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.36623.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35836.log 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36623.log.gz 2024-09-10T11:53:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23967.log 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35836.log: /var/log/ceph/ceph-client.admin.37595.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35836.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37226.log 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.23967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23967.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37226.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2024-09-10T11:53:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35442.log 2024-09-10T11:53:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36034.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz -5 2024-09-10T11:53:37.099 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37832.log 2024-09-10T11:53:37.099 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz 2024-09-10T11:53:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35472.log 2024-09-10T11:53:37.099 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35442.log.gz 2024-09-10T11:53:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38199.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37832.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38776.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38199.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35472.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38199.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36412.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36490.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38776.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36412.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36412.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37884.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35732.log 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37884.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-09-10T11:53:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35524.log 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37884.log.gz 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36252.log 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35732.log.gz 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35524.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.39166.log -- replaced with /var/log/ceph/ceph-client.admin.35524.log.gz 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36989.log 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36252.log.gz 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29432.log 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36989.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.29432.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37174.log 2024-09-10T11:53:37.101 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29432.log.gz 2024-09-10T11:53:37.102 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37410.log 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38568.log 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37174.log.gz 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29340.log 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38568.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37410.log.gz 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38568.log.gz 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35602.log 2024-09-10T11:53:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.29340.log: /var/log/ceph/ceph-client.admin.36675.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29340.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35602.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28879.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35355.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36569.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37462.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36569.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28879.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29287.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36569.log.gz 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37858.log 2024-09-10T11:53:37.109 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37462.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.29287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37936.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37858.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29287.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37858.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38462.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37936.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37569.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37569.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37569.log.gz 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-09-10T11:53:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36438.log: /var/log/ceph/ceph-client.admin.36464.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-09-10T11:53:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2024-09-10T11:53:37.111 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-09-10T11:53:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28964.log 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37252.log 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28964.log: -- /var/log/ceph/ceph-client.admin.39036.log 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28964.log.gz 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36278.log 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37252.log.gz 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38828.log 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36278.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39036.log.gz 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37096.log 2024-09-10T11:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36278.log.gz 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38828.log: /var/log/ceph/ceph-client.admin.37096.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.38828.log.gz -5 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37148.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37096.log.gz 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35550.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37148.log.gz 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36356.log: /var/log/ceph/ceph-client.admin.38279.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35550.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35550.log.gz 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28903.log 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5%/var/log/ceph/ceph-client.admin.37963.log: -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2024-09-10T11:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39062.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38620.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28903.log.gz 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38542.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39062.log.gz 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28928.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38620.log.gz 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37751.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38542.log: /var/log/ceph/ceph-client.admin.28928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37541.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28928.log.gz 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38542.log.gz 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 2024-09-10T11:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37541.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37751.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37541.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35273.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37278.log: /var/log/ceph/ceph-osd.1.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37910.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28952.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35273.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38880.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37910.log: /var/log/ceph/ceph-client.admin.28952.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37910.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28952.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38383.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39088.log 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38880.log.gz 2024-09-10T11:53:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38225.log 2024-09-10T11:53:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-09-10T11:53:37.125 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38383.log.gz 2024-09-10T11:53:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39088.log: /var/log/ceph/ceph-client.admin.38225.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39088.log.gz 2024-09-10T11:53:37.125 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38225.log.gz 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29040.log 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29112.log 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.29040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29009.log 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.29112.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29040.log.gz 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29112.log.gz 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.29009.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28937.log 2024-09-10T11:53:37.136 INFO:teuthology.orchestra.run.smithi112.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29009.log.gz 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29088.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28937.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28937.log.gz 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.29088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29064.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29088.log.gz 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28985.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29064.log: /var/log/ceph/ceph-mgr.x.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28985.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29064.log.gz 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28985.log.gz 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28961.log 2024-09-10T11:53:37.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28961.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28961.log.gz 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.b.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr: 94.3%gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T11:53:37.138 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29025.log 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38147.log 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz/var/log/ceph/ceph-client.admin.29025.log: 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.38958.log 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29025.log.gz 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38147.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38147.log.gz 2024-09-10T11:53:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35833.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35576.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz/var/log/ceph/ceph-client.admin.35833.log: 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35833.log.gz 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35576.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35576.log.gz 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36649.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38594.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28940.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36649.log.gz 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38594.log.gz 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35838.log 2024-09-10T11:53:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37358.log 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28940.log.gz/var/log/ceph/ceph-client.admin.35838.log: 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28792.log 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35838.log.gz 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37358.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37358.log.gz 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36963.log 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39222.log 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28792.log.gz 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36831.log 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36963.log.gz 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28867.log 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39222.log.gz 2024-09-10T11:53:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36831.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36831.log.gz 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38984.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35784.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28867.log.gz/var/log/ceph/ceph-client.admin.38984.log: 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36885.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38984.log.gz 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35784.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35784.log.gz 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37778.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37673.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7%/var/log/ceph/ceph-client.admin.37778.log: -- replaced with /var/log/ceph/ceph-client.admin.36885.log.gz 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38069.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37778.log.gz 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37673.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37673.log.gz 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28976.log 2024-09-10T11:53:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38802.log 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9%/var/log/ceph/ceph-client.admin.28976.log: -- replaced with /var/log/ceph/ceph-client.admin.38069.log.gz 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37489.log 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28976.log.gz 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38802.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38802.log.gz 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38251.log 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37042.log 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37489.log: /var/log/ceph/ceph-client.admin.38251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37042.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38251.log.gz 2024-09-10T11:53:37.151 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37489.log.gz 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37042.log.gz 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36226.log 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9%/var/log/ceph/ceph-client.admin.35834.log: -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29000.log 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36226.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36226.log.gz 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.29000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36038.log 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29000.log.gz 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38750.log 2024-09-10T11:53:37.152 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36038.log: /var/log/ceph/ceph-client.admin.38750.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36038.log.gz 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38750.log.gz 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28915.log 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36779.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz/var/log/ceph/ceph-client.admin.28915.log: 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28915.log.gz 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39192.log 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38698.log 2024-09-10T11:53:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2024-09-10T11:53:37.154 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39192.log.gz 2024-09-10T11:53:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38698.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38698.log.gz 2024-09-10T11:53:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37332.log 2024-09-10T11:53:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35828.log 2024-09-10T11:53:37.160 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2024-09-10T11:53:37.160 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-mds.c.log.gz/var/log/ceph/ceph-client.admin.37332.log: 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37332.log.gz 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28833.log 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35828.log: /var/log/ceph/ceph-mds.a.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35706.log 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35828.log.gz 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28833.log.gz 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37699.log 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36911.log 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35706.log: /var/log/ceph/ceph-client.admin.37699.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35706.log.gz 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37699.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28835.log 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36911.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36911.log.gz 2024-09-10T11:53:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37200.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39010.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28835.log: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.28835.log.gz 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37200.log.gz 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39010.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39010.log.gz 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36701.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37384.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39251.log: /var/log/ceph/ceph-client.admin.36701.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36701.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36384.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37384.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37384.log.gz 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36330.log 2024-09-10T11:53:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38043.log 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36384.log.gz 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36330.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36330.log.gz 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35327.log 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38121.log 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38043.log: /var/log/ceph/ceph-client.admin.35327.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38043.log.gz 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.35327.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-09-10T11:53:37.163 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38121.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38121.log.gz 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28988.log 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35390.log 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38015.log: /var/log/ceph/ceph-client.admin.28988.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28988.log.gz 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38854.log 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37647.log 2024-09-10T11:53:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35390.log: /var/log/ceph/ceph-client.admin.38854.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35390.log.gz 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38854.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35416.log 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37647.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37647.log.gz 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38906.log 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38331.log 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35416.log: /var/log/ceph/ceph-client.admin.38906.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35416.log.gz 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 86.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38906.log.gz -- 2024-09-10T11:53:37.167 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.38672.log 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38331.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38331.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36727.log 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38672.log: /var/log/ceph/ceph-client.admin.36727.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36727.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38409.log 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35837.log: /var/log/ceph/ceph-client.admin.29013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35628.log 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38409.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38409.log.gz 2024-09-10T11:53:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36859.log 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35628.log: gzip/var/log/ceph/ceph-client.admin.36753.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8%/var/log/ceph/ceph-client.admin.36859.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35628.log.gz 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36859.log.gz 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28856.log 2024-09-10T11:53:37.173 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39275.log 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38646.log: /var/log/ceph/ceph-client.admin.28856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35758.log 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr: 77.0% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39275.log: -- replaced with /var/log/ceph/ceph-client.admin.28856.log.gz 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39275.log.gz 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38488.log 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36045.log 2024-09-10T11:53:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35758.log: /var/log/ceph/ceph-client.admin.38488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36542.log 2024-09-10T11:53:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36045.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38488.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35758.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36045.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38516.log 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36542.log: /var/log/ceph/ceph-client.admin.35832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37015.log 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36542.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38516.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38516.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35654.log 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37015.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.35654.log: /var/log/ceph/ceph-client.admin.37806.log 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35831.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35654.log.gz 2024-09-10T11:53:37.177 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37015.log.gz 2024-09-10T11:53:37.178 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-09-10T11:53:37.178 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37806.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37806.log.gz 2024-09-10T11:53:37.211 INFO:teuthology.orchestra.run.smithi112.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T11:53:37.270 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T11:53:37.271 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T11:53:37.277 INFO:teuthology.orchestra.run.smithi112.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T11:53:37.281 INFO:teuthology.orchestra.run.smithi112.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T11:53:37.288 INFO:teuthology.orchestra.run.smithi112.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T11:53:37.293 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T11:53:37.299 INFO:teuthology.orchestra.run.smithi112.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T11:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T11:53:37.341 INFO:teuthology.orchestra.run.smithi078.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T11:53:37.361 INFO:teuthology.orchestra.run.smithi112.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T11:53:37.362 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T11:53:37.362 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m0.257s 2024-09-10T11:53:37.362 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m1.131s 2024-09-10T11:53:37.363 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.059s 2024-09-10T11:53:37.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-10T11:53:37.393 INFO:teuthology.orchestra.run.smithi078.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T11:53:37.394 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-10T11:53:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m0.340s 2024-09-10T11:53:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m1.233s 2024-09-10T11:53:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.099s 2024-09-10T11:53:37.395 INFO:tasks.ceph:Archiving logs... 2024-09-10T11:53:37.395 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/remote/smithi078/log 2024-09-10T11:53:37.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:53:37.719 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/remote/smithi112/log 2024-09-10T11:53:37.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:53:37.851 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1978, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-10T11:53:38.071 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f710f57b7955411b9d21fd7aecabac05 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1978, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-10T11:53:38.074 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T11:53:38.093 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T11:53:38.101 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T11:53:38.101 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:53:38.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:53:38.165 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T11:53:38.173 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T11:53:38.174 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:53:38.176 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:53:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T11:53:38.187 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-09-10T11:53:38.187 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 67.205.162.81 3 u 7 64 377 0.072 -0.249 0.823 2024-09-10T11:53:38.188 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.092 -0.470 0.637 2024-09-10T11:53:38.188 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.095 -1.941 0.949 2024-09-10T11:53:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-10T11:53:38.189 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T11:53:38.189 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-10T11:53:38.190 INFO:teuthology.orchestra.run.smithi112.stdout:*hv01.front.sepi 67.205.162.81 3 u 5 64 377 0.081 -2.409 1.361 2024-09-10T11:53:38.190 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.091 -1.307 1.186 2024-09-10T11:53:38.190 INFO:teuthology.orchestra.run.smithi112.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.089 -1.637 1.192 2024-09-10T11:53:38.190 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-10T11:53:38.191 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T11:53:38.199 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T11:53:38.200 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T11:53:38.229 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T11:53:38.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T11:53:38.319 INFO:teuthology.task.internal:Duration was 1055.172987 seconds 2024-09-10T11:53:38.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T11:53:38.396 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T11:53:38.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:53:38.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:53:38.437 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T11:53:38.438 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T11:53:38.438 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:53:38.487 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T11:53:38.487 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:53:38.497 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T11:53:38.498 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:53:38.531 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:53:38.569 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T11:53:38.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:53:38.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:53:38.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T11:53:38.681 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T11:53:38.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:53:38.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:53:38.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T11:53:38.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:53:38.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:53:38.742 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-10T11:53:38.756 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-10T11:53:38.852 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:53:38.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:53:38.878 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:53:38.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:53:38.898 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T11:53:38.908 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T11:53:38.908 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/remote/smithi078 2024-09-10T11:53:38.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:53:38.941 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899102/remote/smithi112 2024-09-10T11:53:38.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:53:38.962 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T11:53:38.963 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:53:38.983 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:53:39.011 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T11:53:39.020 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T11:53:39.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T11:53:39.074 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T11:53:39.075 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:53:39.077 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:53:39.080 INFO:teuthology.orchestra.run.smithi078.stdout: 658459 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:53 /home/ubuntu/cephtest 2024-09-10T11:53:39.083 INFO:teuthology.orchestra.run.smithi112.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:53 /home/ubuntu/cephtest 2024-09-10T11:53:39.084 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T11:53:39.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T11:53:39.190 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/snapshot}} duration: 1055.1729872226715 failure_reason: '"2024-09-10T11:47:07.257988+0000 mgr.y (mgr.4141) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log' flavor: default owner: scheduled_khiremat@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f710f57b7955411b9d21fd7aecabac05 status: fail success: false 2024-09-10T11:53:39.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:53:39.271 INFO:teuthology.run:FAIL